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Abstract. We develop techniques for computing the integer valued SU{3) Casson in- 
variant defined in [6] . Our method involves resolving the singularities in the fiat moduli 
space using a twisting perturbation and analyzing its effect on the topology of the per- 
turbed flat moduli space. These techniques, together with Bott-Morse theory and the 
splitting principle for spectral fiow, are applied to calculate r3[/(3)(S) for all Brieskorn 
homology spheres. 



1. Introduction 

In this article we compute the integer valued SU (3) Casson invariant Tguf^^j for Brieskorn 
spheres 'E,{p,q,r). Computations of tsiji^^j(Y.{2, q,r)) appear in [6], and we extend those 
computations to all Brieskorn spheres. 

If E is a 3-dimensional homology sphere whose flat SU (3) moduli space is nondegenerate 
and 0-dimensional, then the integer valued SU (3) Casson invariant Tgm^^-^ (E) is simply a 
signed count of the points in the irreducible stratum of the flat moduli space. On the other 
hand, if the moduli space has positive dimension and is nondegenerate in the sense of Bott 
and Morse (or more generally if its lift to the based moduli space is nondegenerate), then 
one can apply standard (equivariant) Morse theoretic techniques to compute the invariant 
Ts[7(3)(E) (see [4]). 

The family of computations given here represents the flrst successful attempt to compute 
the invariant tsu{3) (5^) for manifolds E with truly singular moduli spaces. Even in the 
connected sum theorem of [4] where one encounters components of mixed type in the moduli 
space (i.e., components containing both irreducible and reducible gauge orbits), when lifted 
to the based moduli space, these components become nondegenerate and one can apply 
equivariant Bott-Morse theory to determine the invariant t^^^s). In contrast, the flat SU{3) 
moduli space of the Brieskorn spheres considered in this paper are singular even when lifted 
to the based moduli space. Thus the perturbation techniques presented here go beyond the 
standard theory and in fact provide a new approach to transversality issues that may well 
apply more generally. 

The new approach involves a combination of manifold decomposition and Mayer- Vietoris 
techniques and traditional holonomy perturbations. Simply put, our idea is to construct 
a special type of perturbation (called the twisting perturbation) and analyze its effect on 
the moduli space. We prove that under such perturbations, the moduli space becomes 
nondegenerate and we express the invariant Tgij(^^j in terms of the topology of the perturbed 
moduli space and the spectral flow of the odd signature operator. 

The remainder of this paper is divided into flve sections. Section 2 presents a detailed 
description of the SU{3) representation varieties of Brieskorn spheres. Corresponding results 
for knot complements are given in Section 3. Section 4 introduces the twisting perturbations 
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and describes their effect on the rnoduh spaces. Section 5 presents spectral flow computations 
based on a splitting argument, and Section 6 presents a lattice point count which provides 
numerical calculations of tsu{3) for families of Brieskorn spheres T,{p,q,r), including all 
homology 3-sphcrcs obtained by Dehn surgery on a (p, q) torus knot. The rest of the 
introduction is devoted to outlining the main argument. 

Recall first that if tt is a (finitely presented) group, a representation a: n ^ SU{3) is 
irreducible if no nontrivial linear subspacc of is invariant under a(g) for all g G tt. This 
is equivalent to the condition that the stabilizer of a with respect to the conjugation action 
equals the center of SU{3). Otherwise, a is reducible and its image can be conjugated to 
lie in the subgroup S{U{2) x U{1)). 

Suppose that S is a homology 3-sphere and let -R(S, SU{3)) be the set of conjugacy 
classes of representations a: 7ri(E) — » SU{3). Then -R(E, SU{3)) is a real algebraic variety 
homeomorphic to the moduli space ^(E) of flat SU{3) connections on E. We denote by 
i?*(E, SU (3)) the subspace of conjugacy classes of irreducible representations and by ^*(E) 
the subspace of irreducible flat connections. 

The integer valued SU{3) Casson invariant ts[/(3)(E) is defined in [6] and gives an alge- 
braic count of the conjugacy classes of irreducible representations of 7ri(E), with a correction 
term involving the reducible representations. More precisely, the flatness equations are per- 
turbed so that the flat moduli space becomes nondegenerate, and gauge orbits of irreducible 
perturbed flat connections are counted with sign given by the spectral flow of the su(3) 
odd signature operator. The resulting integer depends on the perturbation used, and to 
compensate for this we add a correction term defined in terms of the reducible stratum. 

For E = T,{p,q,r) the Brieskorn sphere, the analysis of [2] shows that R{T,, SU{3)) is a 
union of path components, each of which is homeomorphic to either an isolated point or a 
2-sphere. More precisely, we will show that each path component is one of the following 
four types: 

Type la: Isolated conjugacy classes of irreducible representations. 

Type Ila: Smooth 2-spheres, each parameterizing a family of conjugacy classes of 

irreducible representations. 
Type lb: Isolated conjugacy classes of nontrivial reducible representations. 
Type lib: Pointed 2-spheres, eacii parameterizing a family of conjugacy classes of 

representations, exactly one of which is reducible. 

The main result in this paper is the following theorem (Theorem 6.2), which describes 
how each of the component types contributes to the SU{3) Casson invariant. This, together 

with enumerations of the components of each type, enable us to calculate the invariant for 
a variety of Brieskorn spheres E(p, q, r). The results of these computations can be found in 
Tables 1 and 2. 

Theorem. Type la, Ila, lb, and lib components each contribute +1, +2, 0, and +2, 
respectively, to the integer valued SU{3) Casson invariant Tgif(^^('E{p,q,r)). 

We conclude the introduction by outlining the proof of this theorem. Components of 
Type la are regular and remain so after small perturbations. The sign attached to each 
such point is positive by the results of [2], and so computing the contribution of the Type 
la points to Tgjj^^-^ (E) reduces to an enumeration problem. This is carried out in Section 6. 

Components of Type Ila are nondegenerate critical submanifolds of the Chern-Simons 
function. Bott-Morse theory, together with a spectral flow computation, implies that each 
such component contributes xi^'^) = 2 to T5^(3-)(E). Thus the computation of the contri- 
bution of the Type Ila components to tsu{3) (^) is s-lso reduced to an enumeration problem 
which is solved in Section 6. 

Components of Type lb do not contribute to T5u-(3)(E) (although they do enter into the 
calculations of the invariant Xsu(3) given in [5]). 
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The only remaining issue is to calculate the contribution of components of Type lib. 
This requires some sophisticated techniques that go beyond those of [6] , where one can find 
computations of tsu{3) for Brieskorn spheres of the form S(2, g, r) (whose representation 
varieties do not contain any Type lib components). The problem is that Type lib compo- 
nents are singular in a strong sense: even their lifts to the based moduli space are singular. 
We introduce a perturbation which resolves these singularities and then carefully analyze 
its effect on the topology of the moduli space. We prove that after applying the perturba- 
tion, each pointed 2-sphere resolves into two pieces, one isolated gauge orbit of reducible 
connections and the other a smooth, nondegenerate 2-sphere of gauge orbits of irreducible 
connections (similar to a Type lla component). 

In defining the perturbation, we regard one of the singular fibers of the Seifert fibration 
E — » 5^ as a knot in E and perturb the flatness equations in a small neighborhood of this 
knot. Consequently, perturbed flat connections are seen to be flat on the knot complement, 
and we study the perturbed flat moduli space in terms of the SU (3) representation space 
of this knot complement. Basically, the perturbed flat moduli space on S is obtained from 
the flat moduli space of the knot complement by replacing the condition "meridian is sent 
to the identity" by a condition of the form "the meridian and longitude are related by a 
certain equation." 

Having resolved the singularities in the Type lib components, we then determine the 
contribution of the reducible, perturbed flat connection to the correction term. This is 
given by the spectral flow (with coefficients) of the odd signature operator. To calculate 
this we prove a splitting theorem for spectral flow determined by the decomposition of S 
into a knot complement and a solid torus. 

Notation. If tt is a discrete group and a: w G is a representation, we denote the 
stabifizer subgroup of a by 

Ta = {geG\ gag~'^ = a}. 
If G is a Lie group, the orbit of a under conjugation is smooth and diffeomorphic to the 
homogeneous manifold G/Ta. We denote the representation variety 

R{tt, G) = IIom(7r, G)/conjugation. 

Given a representation a: w ^ G, we denote its conjugacy class by [a]. Given a manifold 
X, we denote by R{X, G) the representation variety of the fundamental group 7ri(X). 

2. SU(3) REPRESENTATION SPACES OF BRIESKORN SPHERES 

In this section, we identify the components of the 5'C/(3) representation varieties of 
Brieskorn spheres S, both as topological spaces and as varieties with their Zariski tan- 
gent spaces. Crucial to our discussion are computations of the twisted cohomology groups 
which reflect the local structure of the representation varieties. The global structure of the 
representation variety is presented in Theorem 2.6, which gives a complete classification of 
the different path components of i?(S, SU {?>)). 

2.1. Brieskorn spheres. Given integers p, g, r, set 

E(p, g, r) = {(x, y, z)&<C'\xP + y'i + z^ = Q)nS\ 

If p, q, r are pairwise relatively prime then S(p, q, r) is a homology 3-sphere and has surgery 
description in Figure 1 (see [22] for details). Here, a,h,c satisfy 

(2.1) aqr + bpr + cpq = 1. 

The resulting manifold S(p, q, r) is independent of a, b, c, up to orientation preserving home- 
omorphism. Without loss of generality we assume that p and q are odd. 

Proposition 2.1. The numbers a and b can be chosen to be equal. 
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Figure 1. A surgery description of the Brieskorn manifold q, r) indi- 
cating the Wirtinger generators x, y, z, and h for 7ri(E). 



Proof. Since p, q, and r are pairwise relatively prime, r{p + q) and pq are relatively prime. 
Thus there are integers a and c such that 

ar{p + q) + cpq = 1, 

which is equivalent to the condition (2.1) with b = a. □ 

Fix integers a and c as above. Note that since p and q are both odd, c must also be odd. 
A presentation for the fundamental group of g, r) is 

(2.2) ni(Y,{p,q,r)) = {x,y, z,h \ x'^ = y'' = h"" , — h'^ , xyz = 1, /i is central), 

where x,y,z and h are the Wirtinger generators indicated in Figure 1. 

Whenever p, q, and r are clear from the context, we drop them from the notation and 
denote the Brieskorn sphere by S. A regular neighborhood of the singular r-fibcr in S 
is a solid torus whose boundary torus T splits the Brieskorn sphere T, = Y Ut Z, where 
y = £)2 X 5^ is the solid torus and Z = T, — Y is its complement. Alternatively, Z is 
the complement of an open tubular neighborhood of the core of the (^) curve in E and 
depicted in Figure 1. With regard to the natural peripheral structure thus obtained on Z, 
its fundamental group has presentation 

(2.3) TTiiZ) = {x,y,h\ xP = y'> = h",h is central). 

In terms of these generators, the meridian and longitude are represented by 

(2.4) ii={xyyh'' and A = (a;t/)f«/i-(P+«)«. 

Then generates the abelianization of 7ri(Z), and one can check that in Hi{Z), 

(2.5) [x] = aq[ij], [y] = ap[fj], [h] = pq[ij], and [A] = 0. 

2.2. Decompositions of sit (3). In this subsection, we examine the restriction of the ad- 
joint representation of SU (3) on its Lie algebra su{3) to various subgroups. 
Consider first the subgroup 

5C/(2)x{l} = |(^ fj \agSU{2)^cSU{3). 

Then su(3) decomposes invariantly with respect to the adjoint action of SU{2) x {1} as 

(2.6) su(3) = su(2) © ® R, 

where SU{2) x {1} acts by the adjoint action on su(2), by the defining representation on 
C^, and trivially on R. 
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S{U(2) X [/(!)) = 



A e U{2) \ c SU{3). 



More generally, consider the subgroup 



^0 dctA-i 

The decomposition of the Lie algebra su(3) takes the form 
(2.7) sm(3) = s(w(2) X u(l)) © C^ 

where S{U{2) x J7(l)) acts on the first factor via the adjoint representation and on the 
second factor by 

ta tb 



-tb ta 




Zl 
Z2 



azi + bz2 
—bzi + az2 



{\t\ = l, \a\' + \b\' = l). 



There is a canonical isomorphism S{U{2) x U (1)) = U{2). However, the action of S{U (2) x 
[/(I)) on is not the standard U{2) action, even though its restriction to the subgroup 
SU{2)x{l} is standard. 

Every SU{3) matrix is diagonalizable. We parameterize the diagonal matrices using the 
map $ : R2 ^ SU{3) given by 



(2.8) 










pi(-M+D) 






-2iv 



e- ^ 

With respect to the decomposition (2.7), the matrix ^{u,v) acts on by 

<I>(m, v) 













e-'"z2 



Note that the centralizer of S{U{2) x U{1)) is {$(0,u)}, and this circle acts trivially on 

s{u{2) X u{l)) and with weight three on C^. 

2.3. Cohomology calculations. In this subsection, we give computations of if*(I]; su{3)a), 
where a: 7ri(E) — > SU{3) is a representation and SU{3) acts on its Lie algebra su{3) via the 
adjoint representation. First, we establish some notation and recall some basic facts. Let X 
be a cell complex, G a Lie group, V a vector space on which G acts, and a: Tri{X) — » G a 
representation. Denote by Va the local coefficient system determined by a and by i?'(X; 1^) 
the i-th cohomology group of X with twisted coefficients in Va. Although some of the co- 
homology groups we consider have natural complex structures, we use the notation dim(if) 
to refer to the dimension of as a real vector space. 

Given a finite complex X and representation a: tt = tti(X) — > GL(V), we can identify 
W{X;Va) = if*(7r;Vct) for z = 0, 1. Group cohomology H*{TT;Va) can be computed from 
the reduced bar resolution. In this model, the space of (twisted) i-cochains is given by a set 
of functions: 

C°(7r; V) = V, C"(7r; V) = {/: tt x tt — > V}, i > 0. 
We will only need the formulas for the 0-th and 1-st coboundary operators, 

dO(i;)(7) = {j-l).v, di(/)(7i,72) - ./(7i) + 7i • fM ~ /(7172). 

The Fox calculus provides a means to calculate the 1-cocycles, i.e. the solutions / G 
C^(7r; Va) to the equation d^{f) = 0. Given a presentation tt = (xi, . . . ,Xm \ ri, . . . , r„), 
the Fox derivative of a relation Vj with respect to a cocycle / is the element of V obtained 
by using the equation /(7172) = /(71) + 71 • /(72) inductively to express = /(I) = fifj) 
in terms of Xi = f{xi). Note that the map / t-» (/(xi), . . . , f{xn)) is injective on 1-cocyles. 
Most of our computations are given in terms of group cohomology, but occasionally we will 
make use of topological tools such as Poincare duality and the Euler characteristic. 
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Wc now explain the relationship between representation varieties and these cohomology 
groups. Suppose that G is a compact Lie group, acting on its Lie algebra q via the adjoint 
action, and tt is a finitely presented group. Then the Zariski tangent space to (the alge- 
braic variety) R{tt, G) at the conjugacy class of a representation a : tt ^ G is isomorphic 
to H^{i:;Qoi)- Moreover, dimif°(7r; ga) = dimFa, where Fq, C G denotes the stabilizer 
subgroup of a under the conjugation action of G on Hom(7r, G). Equivalently, Va equals 
the centralizer of im(Q!). 

The Kuranishi map embeds a neighborhood of [a] in R{'k, G) into its Zariski tangent 
space modulo Fq,. In particular if H^{-K;Qa) = 0, then [a] is an isolated point in R{tt,G) 
(although the converse is sometimes false). We say that [a] £ R{n,G) is a smooth point if 
a neighborhood of [a] in R{Tr,G) is homeomorphic to H^{n,Qa); otherwise [a] is called a 
singular point. 

We are mostly interested in the case when G = SU{3) and V = su{3). For reducible 
representations, we are interested in the case G = SU{2) and V = su{2) or C^. To see why, 
note that up to conjugation, any reducible representation a: 7ri(S) SU{3) has image in 
the subgroup S{U{2) x U{1)). Since S is a homology sphere, it follows that a has image in 
SU(2) X {!}. Using the decomposition (2.6) we conclude that 

H'(^; su(3)a) = H\J:; su(2)„) © i/^E; C^) ffi ff*(E; R), 

where the first cohomology group has coefficients su{2) twisted via the adjoint action (view- 
ing a as an SU{2) representation), the second has coefficients twisted by the standard 
representation, and the last has untwisted real coefficients. 

Proposition 2.2. Suppose a: 7ri(S) SU{3) is a nontrivial representation. Then a has 

nonabelian image. Moreover: 

(i) If a is irreducible, then a{h) = e^^^^/^/ for an integer k and 

tri/^ /o\ if a{x),a{y), and a{z) each have three distinct eigenvalues, 

otherwise. 



(ii) If a is reducible and has been conjugated to take values in SU{2) x {!}, then 

a{h) - 



±10 
±1 
1 



With respect to the splitting su(3) — su{2) © © K (see equation (2.7)), we have 
H^{Y.; sw(2)„) = 0, i/°(S; ) = 0, H\T,- su(2)„) = and 



C2 ifa{h)=I, 
otherwise. 



Proof. First note that since h is central in 7ri(S), a{h) lies in the centralizer of im(a). 

We now prove (i). Suppose a is irreducible. Then Fq, is the center of SU{3), and hence 
is discrete. Thus a{h) is central and dim J?°(E; su(3)a) = 0. 

Set TT = 7ri(S) and let S'(7r; su{3)a) = im((i*~^) be the coboundaries and Z^{'k; su{3)a) = 
ker(rf') the cocycles in the reduced bar complex. Thus 

if^(7r; su{3)oc) = Z'^{it; su(3)„)/B^(7r; su(3)„). 

Since H^iir; su{3)a) = 0, d° is injective and B^{tt; su{3)a) has dimension 8. So to compute 
H^{Tr; su{3)a) we only need to determine the dimension of the space Z^{tt; su{3)a) of 1- 
cocycles. 
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The Fox calculus identifies Z^ln; su{3)a) with the set of 4-tuples (X,Y, Z, H) in su{3) 
satisfying the equations one gets by taking Fox derivatives of the relations in (2.2). For 
example, the relation hx = xh gives the equation 

H + a{h)X = X + a{x)H. 

Since a{h)X = X, this reduces to H = a{x)H. Similarly, we get the equations H = a{y)H 
and H = a{z)H. Since a is irreducible with image generated by a{x),a{y), and a{z), these 
three equations imply H = 0. 

Setting if = in the remaining equations, we obtain: 

{1 + a{x) + ■ ■ ■ + a{xP-^))X = 0, 

(l + a(y) + --- + a(y«-i))y = 0, 

{l + a{z) + --- + a{z'-^))Z = 0, 

X + a{x)Y + a{xy)Z = 0. 

Case 1: a.(x),a{y) and a{z) all have three distinct eigenvalues. 

Since a{xy = a{h)°' acts as the identity on su{3) via the adjoint action, su{3) decomposes 
as Tx (BUx, where is the tangent space to the maximal torus containing a{x) and Ux is 
the kernel of the map l + a{x) + - ■ ■ + a{xy'^^ : ■su{3) su{3). Note that T.,; is 2-dimensional 
(since a{x) has three distinct eigenvalues) and that a{x) acts trivially on Tx- It follows from 
the equations above that X lies in Ux- Similar statements hold for a{y) and a{z). The space 
of 1-cocycles is therefore a subspace of Ux (B Uy (B Uz- 

Since a is irreducible, TxCiTy = 0. In fact, ift GTxCiTy, then exp(t) e SU (3) stabilizes 
both a{x) and a{y) and hence stabilizes a. Thus Ux n Uy is 4-dimensional, and therefore 
Ux + Uy is 8-dimensional, i.e. Ux + Uy = su{3). 

Since a{x)~^ preserves the decomposition su{3) =Tx (BUx and acts as an isomorphism 
on each factor, the linear map 

Ux®Uy^ su{3), {X, Y) ^ aixy^X + Y 

is onto. Thus the linear map 

{X, Y, Z) ^ a{x) {a{x)-'^X + Y) + a{xy)Z = X + a{x)Y + a{xy)Z 

is also onto. Its kernel is just the space of 1-cocycles, and so dim Z^{'jt; su{3)a) = 10. Hence 
dimH\TT; sm(3)„) = 10 - 8 = 2. 

Case 2: One of a{x),a{y) and a{z) has a double eigenvalue. 

We first show that at most one of a{x),a{y), and a{z) can have a double eigenvalue. 
For example, if both a{x) and a{y) had a double eigenvalue, then the intersection of the 
corresponding eigenspaces would determine a linear subspace invariant under a{x), a{y), 
and a{z) = a{xy)~^, contradicting the irreducibility of a. 

So assume that a{x) has a double eigenvalue and a{y) and a{z) have three distinct 
eigenvalues (the proofs of the other cases work the same way). Under the adjoint action of 
a{x), su{3) decomposes as C^QM'*, where a{x) acts trivially on and by multiplication by 
a nontrivial p-th root of unity on C^. Thus we see that X now lies in a (real) 4-dimensional 
subspace C su{3). Arguing as before, we conclude that dim Z^{'jt; su{3)a) = 4-|-6-|-6— 8 = 
8, from which it follows that 

dimiJ"'"(7r; su{3)a) — dimZ"'"(7r; su{3)a) — dimi?"'"(7r; su{3)a) = 8 — 8 = 0. 

These two cases complete the proof of (i) because irreducibility of a precludes any other 
possibility. To see this, suppose one of a{x),a{y) or a{z) were central, say a(x), then the 
relation xyz = 1 would imply that a{y) commutes with a{z), and hence that a is abelian. 
This would imply a is trivial (and in particular reducible). 
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In proving (ii), wc regard a as an SU{2) representation. Irredncibility of a (as an 
SU{2) representation) implies that H°{T,;su{2)a) = and a{h) = ±1. The fact that 
iJ^(S; su{2)a) = for Brieskorn spheres is well-known (see [12]). Nontriviality of a implies 
ff''(E;C^) = 0, and that leaves i?^(S;C^), which we determine with another application 
of the Fox calculus. The only difference is that we use the defining representation instead 
of the adjoint representation. In particular, — / e SU (2) acts nontrivially. 

Suppose then that {X, Y, Z, H) is a 4-tuple of vectors in satisfying the equations one 
gets by taking Fox derivatives of the relations in (2.2). There are two cases. 

Case 1: a{h) = I. 

As before, H = and a{x) acts by multiplication by a nontrivial p-th root of unity in 
each of the two complex factors. Consequently (1 + a.{x) + ■ • • + a{xP~^))X = for all 
X G C^. Similar statements hold for Y and Z and it follows that {X, Y, Z, H) is a 1-cocycle 
provided H = and X + a{x)Y + a{xy)Z = 0. One can check that the last equation imposes 
four independent conditions, hence dim Z^{'jt; C^) = 4 + 4 + 4 — 4 = 8, and it follows that 

dimH^TT-Xl) = dimZi(7r;C^) - dimSi(7r; ) = 8 - 4 = 4. 
Case 2: a{h) = -I. 

In this case, a{h) acts on by multiplication by —1 and it is no longer true that H = 0. 
Instead, we find that H determines X by the equation (1 — a{h))X = (1 — a{x))H and sim- 
ilarly for Y and Z. An easy check shows that all the remaining equations are automatically 
satisfied, and since H is an arbitrary element in C^, it follows that dimZ^(7r;C^) = 4 and 

dimFi(7r;C2) = dimZi(7r;C2) - dimBi(7r;C2) = 4 - 4 = 

as claimed. □ 

2.4. The representation variety R(S,SU(3)). In this subsection, wc classify the differ- 
ent path components of the representation variety i?(S, SU{^)). To start off, we show that 
every component contains at most one conjugacy class of reducible representations. 

Proposition 2.3. If at, t€ [0,1], is a continuous path of SU{3) representations o/7ri(S) 

with Qo cind ai both reducible, then ao and ot\ are conjugate. Consequently, every path 
com,ponent of R{Y,, 5'C/(3)) contains at most one conjugacy class of reducible representaMons. 

Proof For the trivial representation 9, H^(T,;su{3)0) = ff^(S;IR*) = 0, so [9] is isolated. 
Thus we assume that at is nontrivial for all t. If ao{h) ^ I, then Proposition 2.2 implies that 
[ao] is isolated. So we can assume that ao{h) = I. The continuous function 1 1-^ tr{at{h)) 
takes values in the discrete set {3, -1, Se^'^*/^ Se''''^/^} ^y Proposition 2.2. It follows that 
at{h) = I for all t. The relations (2.2) then imply that at{x), at{y), and at{z) are conjugate 
to fixed p-th, g-th, and r-th roots of unity in SU{3) for all t. (To see this, use continuity 
and the fact that the trace map tr : SU (3) — > C distinguishes conjugacy classes and sends 
the set {A e SU{3) \ A'^ = 1} of all k-th roots of unity into a discrete set.) 

Since ao and ai are both reducible and SU(3) is path connected, we may assume that 
the path at is conjugated so that ao and ai take values in SU{2) x {1}. Thus ao(x) and 
ai(x) each have one eigenvalue equal to 1. But since ao(a;) and ai(a;) are conjugate (in 
SU{3)), the other two eigenvalues of ao(a;) and ai(a;) coincide. The same argument applies 
to y and z. 

It is well-known that the conjugacy class [/3] of a representation /?: 7ri(I]) SU{2) of a 
Brieskorn sphere is completely determined by the eigenvalues of [3{x), j3{y), and P{z) (see 
[12]). Hence ao and ai are conjugate as SU{2) and hence also as SU{3) representations. □ 

Proposition 2.4. Every path component of R{T,,SU{3)) is either an isolated point, a 
smooth 2-sphere consisting of conjugacy classes of irreducible representations, or a pointed 
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2-sphere, which is sw.ooth except for exactly one singular point, the conjugacy class of a 

reducible representation. 

Proof. It is proved in [2, 16] that each path component of SU{3)) is either an isolated 
point or a topological 2-sphere. In the case of an isolated point, there is nothing to prove, so 
assume the path component is a 2-sphcre. Any conjugacy class [a] of irreducible representa- 
tions lying on such a component must have nonzero Zariski tangent space, and Proposition 
2.2 then implies H^{T,; su{3)a) — and we conclude that [a] is indeed a smooth point 
of R{T,, SU{3)). On the other hand, Proposition 2.3 shows that every path component 
of SU{3)) contains at most one conjugacy class of reducible representations. For a 
pointed 2-sphere component, the conjugacy class [(3] of reducible representations is never a 
smooth point, since Proposition 2.2 shows its Zariski tangent space is H^{T,: su{3)(j) = R**. 
(Note that the hypothesis on /3 implies that sm(3)/3) ^ 0, and then Proposition 2.2 

shows that (3{h) = I.) □ 

The next proposition shows that the pointed 2-spheres are in one-to-one correspondence 
with the nontrivial reducible representations sending h to the identity. 

Proposition 2.5. Given a nontrivial reducible representation a: 7ri(I]) SU{3), the fol- 
lowing are equivalent: 

(i) aih) = /, 

(ii) H'iE;Cl)^0, 

(iii) There exists a family of irreducible SU{3) representations limiting to a. 

The collection of pointed 2-spheres in R{T,, SU{'S)) are therefore in one-to-one correspon- 
dence with conjugacy classes of nontrivial reducible representations a: 7ri(S) — > SU{3) with 
a{h) = I. Further, tra{z) is constant along a pointed 2-sphere. 

Proof The statement (i) <^ (ii) follows from Proposition 2.2, (ii). The implication (iii) 
(ii) follows because the Kuranishi map locally embeds i?(S, SU{3)) near [a] into its Zariski 
tangent space H^{'E;su{3)a) modulo Ta, and the Zariski tangent space equals if^(S;C^) 
by Proposition 2.2. 

For the implication (i) (iii), notice that a representation a: 7ri(I]) SU{3) satisfying 
a{h) = I uniquely determines an SU{3) representation of the (free) group F = {x,y,z \ 
xyz = 1). Fix three conjugacy classes a,b,c in SU{3) and consider the space ^abc con- 
sisting of conjugacy classes of representations a: F ^ SU{3) with a{x) € a, a{y) G b, and 
a{z) e c. In [16], Hayashi gives necessary and sufficient conditions on a, b, c for ^abc to be 
nonempty. The resulting inequalities (18 in all) determine a convex, 6-dimensional polytope 
P parameterizing all triples (a, 6, c) with ^abc 7^ 0- Hayashi observes further that ^abc 
is a 2-sphcrc whenever (a, b, c) lies in the interior of P and is a point whenever (a, b, c) lies 
on the boundary of P. For more details, turn to Subsection 6.2 and read Theorem 6.3. 

The key to proving that (i) => (iii) is to show that the triple (a, fe, c) determined by 
a{x), a{y), a{z) lies in the interior of P. From this, it follows that ^abc, which is connected 
and contains [a], is a 2-sphere. Assume to the contrary that (a, b, c) is a bomidary point 
of P. There are two possibilities, because there are two kinds of boundary points. The 
first kind occurs when one of the inequalities in equation (6.3) is an equality. This cannot 
happen for (a,b, c) because a{x) , a{y) , a{z) are, respectively, p-th, q-th, and r-th roots of 
unity in SU{3) and p, q, r are pairwise relatively prime. The other kind of boundary point 
of P occurs when one of a{x), a{y). a{z) has a repeated eigenvalue. If a{x) were to have a 
repeated eigenvalue, then since a has image in SU{2) x {1} (up to conjugation), it follows 
that 1 is an eigenvalue of a{x), and so its other eigenvalues are either both -|-1 or both — 1. 
In either case, it follows easily that a{x) commutes with a{y) and a.{z), and the relation 
xyz = 1 then shows that a has abelian image. Since E is a homology sphere, this implies a 
is trivial and gives the desired contradiction. □ 
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The computations of Propositions 2.2 2.5 give a decomposition of R{'E, SU{3)) into the 
various different types, summarized in the following theorem. 

Theorem 2.6. The path components of the representation space SU{3)) come in the 
following four types. (Notice that in each case, the image of h is constant along the compo- 
nent and the conjugacy classes of the images of x, y, and z are also constant.) 

(i) The Type la components consist of one isolated conjugacy class [a] of irreducible 
representations with the property that exactly one of a{x) , a{y) , a{z) has a repeated 
eigenvalue. The representation a: 7ri(E) SU{3) sends h to a central element and 
has i7i(S;sM(3)a) =0. 

(ii) The Type Ila components are smooth 2-spheres consisting of conjugacy classes of 
irreducible representations a with the property that a{x) , a{y) , a{z) each have three 
distinct eigenvalues. For any conjugacy class [a] in a Type Ila component, the repre- 
sentation a: 7ri(i;) SU{3) sends h to a central element and has H^{T,; su{3)a) — 

(iii) The Type lb components consist of isolated conjugacy classes [/?] of reducible rep- 
resentations. The only isolated, reducible conjugacy class [/?] with p{h) = I is the 
conjugacy class of the trivial representation. If [(3] is isolated, reducible, and nontriv- 
ial, then tr{P{h)) = -1 (i.e. (3{h) = -I as an SU{2) element) and i?i(E;Cp = 0. 

(iv) The Type lib components are topological 2-spheres containing exactly one conjugacy 
class [/3] of reducible representations with {T,; su{3) = i?"'^(S:C?j) = M^. Every 
other conjugacy class [a] in a Type lib component is a smooth point with a irre- 
ducible and satisfying II^{T,; su{3)a) =M?. In particular, the reducible orbit is the 
only singular point. Every conjugacy class of representations in a Type lib com- 
ponent sends h to the identity and sends x, y and z to elements with three distinct 
eigenvalues. 

The way in which a component type contributes to the integer valued SU{3) Casson 
invariant is explained in Theorem 6.2. 

Proposition 2.7. The representation variety R{'E{p, q, r), SU{3)) contains a Type lib com- 
ponent if (and only if) none ofp,q,r equal 2. 

Proof. Suppose first that r = 2 and a: tti (S(p, 2)) — » SU{2) is a representation with 
a{h) = I. Then a{z)'^ = I, hence a{z) = ±7 is central. Thus a{y) = ±a(x)^^, which 
implies a is abelian and hence trivial. Thus, up to reordering, if one of p, q, r equals 2, then 
R{T,{p,q,r), SU{3)) does not contain a Type lib component. 

On the other hand, if none oip,q,r equals 2, the results of [12] prove the existence of 
nontrivial representations a: tti r)) — > SU{2) with a{h) = I. Apply Proposition 2.5 
to complete the proof. □ 

3. SU(3) REPRESENTATION SPACES OF KNOT COMPLEMENTS 

We next carry out a similar analysis of the SU(3) representation variety R{Z,SU{3)) of 
the knot complement Z obtained by removing a neighborhood of one of the singular fibers 
of S(p,g',r). 

We explain our purpose first. The inclusion Z ^ Yi induces a surjective map ni{Z) 
7ri(S). In terms of the presentation (2.3), this map is given by imposing the relation fi — 1. 
Consequently the representation variety SU{3)) can be viewed as the subvariety of 
R{Z, SU{3)) cut out by the equation determined by the condition that "the meridian is sent 
to the identity." By perturbing, we will replace this equation by a condition of the form 
"the meridian and longitude are related by the equation 4.7." Hence, the perturbed flat 
moduli space can also be identified as a subset of R{Z, SU{3)). The results on the local and 
global structure of the representation variety R{Z, SU{3)) that are developed in this section 
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will tlmc'fore be essential to our understanding of the behavior of the moduli space under 

perturbation. 

3.1. Cohomology calculations. Let Z be the complement of the singular r-fiber in E(p, g, r). 
In contrast to the homology sphere case, the abelianization of 7ri(Z) is nontrivial. Conse- 
quently, Tri{Z) admits nontrivial abclian representations, and reducible representations of 
7Ti{Z) do not always reduce to SU{2) x {1}. Given a representation a: i^i{Z) — » SU{3), 
there are three possibilities: 

(i) a is irreducible, 

(ii) a is nonabelian and reducible, or 

(iii) a is abelian. 

The first result is the analogue of Proposition 2.2 for the knot complement Z. 

Proposition 3.1. Suppose a: 7ri(Z) SU{3) is a nonabelian representation. 

(i) If a is irreducible, then a{h) = e^'^^^l'^ . /, H.^{Z\ su(3)q,) = 0, and 

H^{Z- (3) ) and a{y) have three distinct eigenvalues, 

' otherwise. 

(ii) If a is reducible and has been conjugated to take values in S{U{2) x U{1)), then 

" 

a(h)= e'" 


With respect to the splitting su(3) = s{u{2) x u(l)) © (see equation (2.7)), we 
have H°{Z;s{u{2) x u(l))a) = M, H°{Z;Cl) = 0, H^{Z;s{u{2^) x w(l))c«) = M^ 
and 

if a{h) is central, i.e., if e^^'" = 1, 
otherwise. 



H\Z;Cl) 



Proof. This proof is similar to that given for Proposition 2.2. We leave the details as an 
exercise for the reader. See also the proof of Lemma 3.3. □ 

Proposition 3.2. Suppose a: ni{Z) SU{3) is a nonabelian representation. 

(i) If a is irreducible, then 

I, /o\ \ if C({x) and a{y) each have three distinct eigenvalues, 

H {Z,dZ;sui3U) = ^^, oi/.en.^se. 

(ii) If a is reducible and has been conjugated to take values in S{U{2) x f/(l)), then with 
respect to the splitting su{3) = s{u{2) x u{l)) ® C^, we have H'^{Z,dZ; s{u{2) x 
u{l))a) = R and 



H\Z,dZ;Cl) = i^" ^/a(/.)^.cen^^a^, 
I otherwise. 



The map H^(Z,dZ;Cl^) H^{Z;C'^) induced by inclusion is an isomorphism. 
Proof. Associated to 

{dZ, 0) ^ {Z, 0) ^ {Z, dZ) 
is the long exact sequence in cohomology 

(3.1) > H\Z,dZ) ^ H\Z) ^ H\dZ) ^ W+'^{Z,dZ) ^ ■■■ . 

(We are temporarily omitting the coefficients from the notation.) To prove part (i), con- 
sider this sequence (3.1) with coefficients su{3)a. The previous proposition shows that 
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H'^ {Z ; su{3) a) = 0. Additionally, since dZ is a 2-torus, Poincarc duality shows that 
H°{dZ;su{3)a) = M" = H^idZ-su{3)a) and H^{dZ; su{3)a) = M^". (In fact, n = 4 or 
2 depending on whether a(/x) has a double eigenvalue or not, but this has no bearing on the 
rest of the argument.) 

The nondegenerate pairing between relative and absolute cohomologies gives 

dimiJX^, dZ; sw(3)a) = ^miH^-\Z; su(3)„). 

(E.g., H^{Z;dZ:su{3)a) = 0.) The long exact sequence (3.1) with coefficients su{3)a has 
only seven nontrivial terms. Any long exact sequence has Eulcr characteristic zero, and so 

dimH^{Z,dZ;su{3)a) = dimiJi(Z; sM(3)a). 

The proof of part (ii) is similar; in fact, for the coefficients C^, it is simplified by the 
observation that W(dZ-Xl) = 0, and hence H^{Z]<Cl) = H^{Z,dZ;Cl) as claimed. The 
long exact sequence (3.1) with coefficients s(u(2) x u{l))a has nine nontrivial terms, starting 
with H°{Z;s{u{2) x u{l))a) which equals R by the previous proposition, and ending with 
H^{Z,dZ;s{u{2) x u{l))a) which also equals M by the nondegenerate pairing. Arguing as 
before, it is not hard to see that 

dimH\Z,dZ;s{u{2) x u{l))a) = dim H\Z; s{u{2) x M(l))a) -1 = 2-1 = 1. 

□ 

We now turn our attention to the cohomology of the abelian representations of tti (Z) . 
To warm up, consider a nontrivial representation a: 7ri(Z) — > U{1). The following lemma 
computes H^{Z;Ca) and H'^{Z;Ca). 

Lemma 3.3. Suppose a: 7ri(Z) — > U{1) is a nontrivial representation. Then H^{Z; Co) = 
and 



H\Z;Ca) = 



C ifa{ii)Pi = 1, aiiiyP ^ 1 and a(At)'^« ^ I, 
otherwise. 



Proof. We can compute the first two cohomology groups of Z using the cellular cohomology 
of the 2-complex Z2 determined by the presentation of 7ri(Z). The group presentation de- 
termines a cellular structure with one 0-cell, three 1-cells, and four 2-cells. The differentials 
in the cellular cochain complex for the universal cover of Z2 are 



X - 1 
h-l 



1-h .T - 1 

1-h y-1 

l + x + --- + xP-^ ^xP{h-^ + --- + h-<') 

1 + 2/H hy''"^ -yi{h-^ ^ h /?-"") 



Taking the tensor product with C over the representation a has the effect of replacing 
x,y, and h in the matrices dP and d^ by a{x),a{y) and a{h). We denote the resulting 
matrices by d^ and d^, and so the cochain complex C*{Z2; C^) has the form 

Since a is nontrivial, it follows that rf^ is injective, hence H^{Z; C^) = and H^{Z; C^) 

has dimension 3— rank((i;|j) — 1. 

Notice that [x] — aq[fj], y = ap[/i], and h = pq[ij] in homology. If a{^)P'^ 7^ 1, then 
a{h) — 1^0, and so the rank of d\ is at least two, and hence is exactly two. Thus 
H^{Z;Ca) = if a(^)P« ^ 1. This leaves the case when a(/i)P'' = 1, i.e., when a(/i) = 1. 
In this case, a{x) = a(/U,)'^* is a p-th root of unity and a{y) — a{^)°'P is a g-th root of unity. 
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Thus 



di = 





1 + a{x) + ■■■ + a{x)P-'^ 

1 + a(y) + • • • + a(2/)9-i 



a{x) — 

a{y) - 

—a 
—a 



This matrix has rank 2 unless a{x) is a nontrivial p-th root of unity and a{y) is a nontrivial 
q-th root of unity, in which case it has rank 1. The lemma follows. □ 

Now consider abelian representations a : Tri{Z) — > SU{3). By conjugation, we can assume 
that a takes values in the maximal torus T c SU{3). Under the adjoint action of T, the 
Lie algebra su{3) decomposes as 

(3.2) su(3)=C^eR^. 

The corresponds to the off-diagonal entries and M? to the diagonal entries. Then T acts 
trivially on and by rotations on each of the three complex factors. More precisely, the 
action on is given by 













Zl 




LU1UJ2 Zl 





UJ2 







Z2 




l^fuJ2 Z2 








U)lU)2 




. ^3 . 







An abehan representation a: ni{Z) SU{3) is completely determined by a^fj,), since 
H\(Z\%) is generated by Suppose in addition that a is the limit of a sequence of 
SU{2) X {1} representations. Then we can arrange that 



(3.3) 



w 
u) 
1 



In this case, there is a distinguished subbundle of the adjoint bundle Z x su{3) on which 
a(p) acts by (zi, Z2) ^ {ujzi,ujz2) (namely the last two coordinates in C"^). Suppose further 
that a is nontrivial. Then H°{Z;Cl) = 0. Applying Lemma 3.3 to = C^, © C^,, and 
noting that H*{X; C^,) = H*{X; C^), we see that 



H\Z;Cl) 



if < 



1 and cu^P j^lj^ CO" 



otherwise. 



The next proposition extends these computations to abelian representations in a neighbor- 
hood of a. 

Proposition 3.4. Let a: tti{Z) — > SU{3) be a fixed nontrivial, abelian representation with 
a{p,) given by the diagonal matrix in equation (3.3). Suppose further that ljP'^ = 1 and 
(jj"-P ^ 1 ^ (jj"-''. (Thus H^{Z;C'^) = C^.j Consider abelian representations /?: t^i{Z) —> 
SU{3) near to but distinct from a. Conjugating, we can arrange that 

m 



wi 

UJ1LU2 



with LUi close to ui and L02 close to u (so (jJiuj2 is close to 1). Then, for /3 close enough to 
a, we have H°{Z;C'^) = and 



H\Z;Cl)= H\Z,dZ -Cl) 



C if {ujfuj2)P'^ = I or if (a;iw|)P« 
otherwise. 
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Proof. That H'^{Z; C|) = follows from upper scmicontinuity of dimH^ on the representa- 
tion variety. The computation of H^{Z\ C^) follows from Lemma 3.3, keeping in mind that 
our hypotheses exclude the possibility f3 = a. All that remains is to prove the claim about 

relative cohomology. Set T = dZ. If 7: 7ri(T) SU{2) is any nonirma/ representation, 
then H*{T;C'^) = (cf. equation (3.4) of [5]). Now using the long exact sequence in coho- 
mology, it follows that H^{Z;C'^) = H^{Z,dZ;Cf3) for /3 in a small enough neighborhood 
of a. □ 



3.2. The representation variety R(Z,SU(3)). In this subsection, we give a description 
of R{Z, SU{3)). This space is the union of three different strata: 

(i) R*{Z, SU (3)), the stratum of irreducible representations. 

(ii) R'^'"^{Z, SU{3)), the stratum of reducible, nonabelian representations. 

(iii) R^^{Z, SU{'S)), the stratum of abclian representations. 

We will describe each of these strata presently. For R*{Z,SU{3)), this involves certain 
double coset spaces, and for R''''^{Z, SU{3)), this builds on the results in [20]. Note that, 
given any finitely presented group tt, two nonabelian representations ao, ai : tt ^ S{U{2) X 
[/(!)) are conjugate in SU{3) if and only if they are conjugate by a matrix in SU{2) x {!}. 
In particular, the natural map R*{Z, S{U(2) x U{1))) —>■ R{Z, SU{3)) is injective and has 
image in SU{3)). 

We begin with the description of R'^^{Z, SU{3)) because it is the simplest. Since the 
homology class of the meridian /z generates Hi{Z; Z), a conjugacy class [a] of abelian repre- 
sentations is completely determined by the conjugacy class of Q:(/i). Thus, R^''{Z, SU{3)) is 
parameterized by the quotient <S't/(3)/conj, which is just the quotient T/S3 of the maximal 
torus by the Weyl group. This is parameterized by the standard 2-simplex A, see equation 
(6.2) in Subsection 6.2. 

For the stratum R'''^'^{Z, SU{3)), note that every reducible representation can be conju- 
gated to have image in S{U{2) xU{l)). We will see that every S{U{2) x U{1)) representation 
of 7ri(Z) is obtained by twisting an SU{2) representation, and we will combine this observa- 
tion with an explicit description of the SU{2) representation varieties of ni{Z) (essentially 
from Klassen's work [20]) to prove that R'"^{Z, SU{3)) is a union of [p - l){q - l)/4 open 
2-dimensional cylinders under the assumption that p,q are both odd (see Proposition 3.9). 

Let a: ni{Z) — > SU{3) be a nontrivial reducible representation sending [xyYh'^ to the 
identity. Thus a extends over the solid torus and gives a reducible representation tti (S) 
SU{3). In particular, a reduces to SU{2) x {1} and is nonabelian. 

In Proposition 3.1, we computed that H^{Z;s{u{2) x u{l))a) = R^, hence the reducible 
stratum R''^{Z, SU{3)) has 2-dimensional Zariski tangent space at [a] . In this subsection, we 
construct an explicit 2-parameter family of reducible representations a^.t : ^i(^) SU{3) 
near a, showing that all the Zariski tangent vectors are integrable. From this, we will 
conclude that the reducible stratum R'''^'^{Z,SU{3)) is smooth and 2-dimensional near [a]. 

The 2-paramcter family will be obtained by twisting SU{2) x {1} representations of tti{Z) 
to representations with image in S{U{2) x U{1)). To get started, we describe the SU{2) 
representation variety of 'k\{Z). Note that we have assumed that p and q are both odd in 
the presentation (2.3). The following result is proved by techniques developed by Klassen 
in [20]. The methods he uses to describe SU{2) representation varieties of complements of 
torus knots work equally well for the 3-manifolds Z considered here. We view SU{2) as the 
unit quaternions and write a typical element as a + ih + jc + kd where a, 6, c, G M satisfy 
a-^ + p + c^+d^ = 1. 

Proposition 3.5. R*(Z, SU{2)) consists o/(p— 1)(<7— 1)/2 ope.n arcs of irreducible represen- 
tations. These arcs are given as follows. For each k £ {I,-- - ,p—l}, £ £ {!,••• ,q—l},£ G 
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{0, 1} satisfying k = £ = ae (mod 2), the assignment to s & [0, 1] : 
l3s{x) = cos(7rfc/p) + isin(7rfc/p), 
l3s{y) = cos{Tr£/q) + sm{'jTi/q){icos{7rs) + j sm{7rs)) 

defines a path of SU{2) representations which are irreducible for s £ (0,1). Moreover, for 

se(o,i), 

ife = 0,i.e.,ifP,{h) = l, 
tfe = l, I.e., if0s{h) = -1. 

are abelian representations sending fi 



The two limit points of each open arc, (3q and (3\ 
to {-Ife^"^) and [-ife^"^). 



□ 



(The cohomology calculation in Proposition 3.5 follows from Proposition 3.1.) 

To summarize, the subspace of R{Z, SU{i)) consisting of conjugacy classes of non- 
abelian SU{2) x {1} representations of 'Ki{Z) is a union of {p — l)((j — l)/2 open arcs 
with ends that limit to points in the abelian stratum. The intersection of the subspace 
R{Y,,SU{2>)) C R{Z,SU{Z)) with such an arc of reducible representations consists of ei- 
ther reducible representations on pointed 2-spheres or isolated reducible representations 
(i.e. Type lb representations), depending on whether or not h is sent to /. 

In defining these 1-parameter families of representations, we arranged that x was sent 
to a diagonal matrix. For future applications, it is convenient to arrange (by conjugation) 
that xy is sent to a diagonal matrix, because then it follows from equations (2.4) that the 
meridian and longitude will also be diagonal. 

Fix a connected component oiR*{Z, SU{2)) determined by the triple (fc, £, e) with k = £ = 
ae (mod 2) as above, and denote by the corresponding arc of SU{2) x {1} representations 
sending xy to a diagonal matrix. A short calculation shows that 





as{xy) 











where u satisfies the equation 

(3.4) cos(u) = cos(7rfc/p) cos{n£/q) — sin(7rfc/p) sm{7r£/q) cos(7rs). 

We next show that the arc [as] of SU{2) x {l}-representations is a codimension one subset 
of R'''"^{Z, SU{3)). The other degree of freedom comes from twisting a representation out of 
SU{2) X {1}, keeping it in S{U{2) x U{1)). 
First, given 

a b 
—b a 



A = 



e SU{2), 



the twist of A by e'^ G U{1) is the S{U{2) x U{1)) matrix 
























-2ie 









e'% 







e'^a 














The map SU{2) x [/(I) S{U{2) x C/(l)) defined by twisting is a 2-to-l map. In terms 
of U{2), this is simply the description U{2) = SU{2) x^^ '^(l), and twisting is just scalar 
multiplication by e*''. Notice that the matrix <!>(«, v) appearing in equation (2.8) is the twist 
of the diagonal SU{2) matrix A with entries e*", e^'" by e™. 

Suppose X- U{1) is a character, i.e. a homomorphism into the abelian group 

C/(l), and let f3: 7ri(Z) SU(2) be a representation. The reducible SU('S) representation 
obtained by twisting /3 by x is defined to be representation ni{Z) S{U (2) x U (1)) taking 
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an element w e t^i{Z) to the twist of j3{w) by x(''^)- Notice that, since Hi{Z;Z) = Z 
is generated by the meridian /x, any character x is completely determined by the element 
X(m) £ '^(l); which can be arbitrary. If x(a*) = —1, then the twist of /3 by x is again an 
SU{2) representation, and twisting by this central character defines an involution on the 
SU (2) representation variety of knot complements. 

We give a more explicit description of the stratum W'^'^{Z,SU{2>)) of reducible S'?7(3) 
representations in terms of twisting the arcs described above. 

Definition 3.6. Fix e*^ e U{1) and let xe be the character sending /i to e'^. Let as be 
representation described in Proposition 3.5 corresponding to a triple {k,i,e) and s € (0, 1). 
Define the reducible SU{3) representation a^,^: 7ri(Z) -y S{U{2) x U{1)) C SU{3) to be 
the twist of by xe- 

Proposition 3.7. Fix {k,£,e) with k = £ = as (mod 2) as in Proposition 3.5 and let Usfi 
he the 2-parameter family of S{U{2) x U{1)) representations corresponding to twisting ag 
by 9. Then the representation asfl sends x to the twist of as{x) by e*"'^^, y to the twist of 
<^s{y) by e"'^'^, and h to the twist of as{h) by e'^"^^. Moreover, 

\kc ^i{6-\-ru) 



ots,e{lJ) = 



{-If 





1 \kcpi{0—ru) 



(-1) 







-ne 



and 



as,e(A) = as (A) 



(^_X)fco(p+g)g-ip9« (] 

1 

where u satisfies equation (3.4)- The representation as^e is conjugate to an SU{2) x 
{1} representation only for 6 e ttZ, and the arcs agfi and a^^jr tM'e different components 
of R{Z,SU{2)). The map {s,6) Ug^g defines a smooth 2-dimensional subvariety of 
R{Z,SU{3)) contained in R'''"^{Z,SU{3)) and homeomorphic to (0,1) x 5^ 

Proof. The first few assertions follow immediately from the definitions and equations (2.4) 
and (2.5). 

By taking the determinant of e^^Ug, it is easy to check that ag^e is an SU{2) x {1} 
representation if and only li 9 ^ ttZ. The representation ag^ takes h to the diagonal 
matrix with entries (— 1)*^, (— l)"^, 1 and a^^Tr takes h to the diagonal matrix with entries 
(_l)p<?+e^ (— 1)^"^+^,!. Since p and q are both odd, a^^o and a^^^ are different arcs. The 
map (s,6») ^ [ttgfi] e R{Z,SU{3)) is injective, and since H'^{Z\s{u{2) x u(l)))„,_J = 
by Proposition 3.1, this parameterizes a smooth subvariety. □ 

Every representation a in R'^'^{Z, SU{3)) is conjugate to some Ug^e for some choice of 
{k, £, e) and (s, 6*). The reason for this is that one can first conjugate a into S{U (2) x U{1)), 
and then if the (3, 3) entry of a{iJ,) is e^'^, a must be the ^-twist of some SU{2) representation 

Ctg. 

By Proposition 3.5, it follows that R''°'^{Z, SU{3)) has exactly (p—l)((7—l)/4 components, 
each of which is a smooth open cylinder with two seams of SU{2) x {1} representations (see 
Figure 2). 

Remark 3.8. It is not hard to extend Proposition 3.7 to the case when either p or is even. 
In that case it is possible for ag^ and Ug^^ to represent the same arc, with a reversal of 
orientation, and hence there are components of R'''^'^{Z, SU(3)) homeomorphic to an open 
Mobius band. For example, the space of nonabelian reducible SU (3) representations of the 
Trefoil knot complement is a single Mobius band. 



The following theorem summarizes our discussion. 
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Figure 2. An open cylinder of reducible SU{3) representations with two 
seams (the dotted lines) representing the SU{2) x {1} representations. 

Theorem 3.9. Suppose T,{p,q,r) is a Brieskorn sphere and reorder p,q,r so that p and 
q are both odd. Let Z he the complement of the singular r-fiber of T,{p,q,r). Then the 
stratum R'''"^{Z, SU{3)) of conjugacy classes of nonabelian reducible representations is a 
smooth, open, 2-dimensional manifold consisting of {p —\){q — l)/4 path components, each 
of which is dijJeom,orphic. to the open cylinder (0,1) x 5*^. The closure of such a component 
in R{Z,SU{3)) contains two boundary circles, which are circles immersed in the abelian 
stratum R^^{Z, SU{3)) with isolated double points. 

Fix {k,£,s) with k = £ = as (mod 2) as in Proposition 3.5 and let ag^g: Tfi{Z) ^ 
S{U{2) X C/(l)) denote the corresponding 2-parameter family of representations. Suppose 
for some s, as,o extends to a reducible representation on 7ri(S). This is the case if and only 
if asfiin) = I, namely if asfi{xy) is an r-th root of asfl{h^). 

Since (E; sm(2)„^ q ) = and S is a homology sphere, none of the nearby representations 
in the 2-parameter family ag^e of i^i{Z) extend to representations of 7ri(E). 

If [asfi] lies on a 2-sphere component of -R(S, SU{3)), then H^{T.] C^) ^ and asfi{h) = I 
(i.e. £ = 0). Hence as^Q{xy) is an r-th root of / and s satisfies the equation 

cos (^^) = cos(7rfc/p) cos{-Kt/q) — sm{'Kk/p) sm{'jTi/q) cos(7rs) 

for some < m < r. In particular, 

e--27^im/r q 

1 



(3.5) asfiixy) 



We now consider irreducible representations a: 7Ti{Z) SU{3) and give a description of 
the closure of R*{Z,SU{3)). We begin with a simple observation. If a: t^i{Z) SU{3) is 
an irreducible representation, then a{h) lies in the center of SU{3) and it follows from the 
presentation (2.3) that a{x)P = a{yY = a{h)°'. Conversely, suppose we are given matrices 
A,B,H G SU{3) with H central such that 

(3.6) AP = B'' = if", 

then setting a{x) = A, a{y) = B, and a{h) = H uniquely determines a representation 
a: 'Ki{Z) — > SU{3). This representation is reducible if and only if A and B share an 
eigenspace. 

For A,B,H diagonal SU{3) matrices with H central and satisfying equation (3.6), we 
can write H = e^'^*^/''/ for a unique £ G {0, 1, 2} and we denote by "^js C R{Z, SU{3)) the 
subset of conjugacy classes [a] of representations with a{x) conjugate to A, a{y) conjugate 
to B, and a{h) = e2-m(/?.j^ r^YicYC is a map SU{3) -> '^^g whore *(,g) = [i{)g\ is the 
conjugacy class of the representation ijjg with ^pgix) = A and ijjg{y) — gBg^^. Let Ta and 
Tb denote the stabilizer subgroups of A and B. If 7 G Fg, then ipg^ = ipg for all g G SU{3). 
Likewise, if 7 G F^, then ^p^g = 7V'g7~^ for all g G 5?7(3). Thus, ^ factors through left 
multiplication by F^ and right multiplication by Fb and determines a map from the double 
coset space 

*:r^\5[/(3)/FB^'^iB 
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which is a homconiorphisin which is smooth on the stratum of principal orbits. 

Elementary dimension counting gives that "^^^ has dimension four if both A and B have 
three distinct eigenvalues and dimension two if exactly one of A or B has a 2-dimensional 
cigcnspacc. In all other cases, "^^g docs not contain any irrcduciblcs. For example, if 
both A and B have double eigenspaces, then the eigenspaces intersect nontrivially in an 
invariant linear subspace, giving a reduction. Similarly, if either A oi B has an eigenvalue 
of multiplicity three, then the corresponding representation is necessarily abclian. 

Observe further that the set '^^^ depends only on e {0, 1, 2} and the conjugacy classes 
of the matrices A and B. Thus, we can assume without loss of generality that A and B are 
both diagonal. 

Theorem 3.10. The closure of the stratum R*{Z, SU (3)) of irreducible representations is 
a union [J '^^g , where the union is over pairs {[A],[B]) G {SU{3)/conjy and £ e {0,1,2} 
satisfying the conditions: 

(i) AP = Bi = H'', where H = gS'^'^/S/, 

(ii) neither A nor B is central, and 

(iii) one of A or B has three distinct eigenvalues. 
In particular 

• If one of A or B has a repeated eigenvalue, then ^Xb 2-dimensional and is called 
a Type I component of R{Z, SU{3)). 

• If both A and B have three distinct eigenvalues, then '-^ab 4-dimensional and is 
called a Type II component of R{Z,SU{3)). 

Given a nonabclian reducible representation a: tti{Z) SU{3), we would like to know 
when there exists a 1-parameter family of irreducible representations limiting to a. If there 
is, then Proposition 3.1 implies that a{h) is central. The following proposition is a partial 
converse. 

Proposition 3.11. If a: i^i{Z) — > SU{3) is a nonabclian reducible representation satisfying: 

(i) a{h) is central, and 

(ii) one of a{x) or a{y) has three distinct eigenvalues, 

then there exists a 1-parameter family of irreducible 5(7(3) representations limiting to a. 

Remark 3.12. Notice that the condition H^{Z;C'^) ^ 0, which is equivalent to (i), is not 
enough to guarantee that there be a family of irreducible representations limiting to a. 
There axe nonabclian reducible representations with a{h) central such that a{x) and a{y) 
both have repeated eigenvalues. Such representations are not in the closure of R*{Z, SU{3)) 
even though H\Z; ) ^ 0. 

Proof. Set A — a{x) and B — a(y). Notice that the assumption that a is nonabclian implies 
that neither A nor B is central. Obviously [a] G '^^ab- The subspace '^S'^g'^ of conjugacy 
classes of reducible representations has codimension greater than or equal to one, and this 
completes the proof. □ 

It is not hard to show that '^^ab^ dimension one. We leave this as an exercise for 
the reader. Note that ^^^^ is also a codimension one subset of R'^°'^{Z, SU{3)). The next 
lemma is a slight reformulation of [16, Lemma 2.4]. We include the proof for the sake of 
completeness. 

Lemma 3.13. Suppose A,Bg SU{3) are diagonal matrices and consider the maptp: SU{3) — > 
C defined by setting ip{g) = tr{AgBg~^). Then, for fixed g G SU{3), the differential dipg is 

surjective provided 

(i) A and gBg~^ have no common eigenvectors, and 
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(ii) the product AgBg ^ has three distinct eigenvalues. 

Equivalently, dcpg is surjective if ipg- ttiZ — > SU{3) is irreducible and ■tpg{xy) has 3 distinct 

eigenvalues. 

Proof. Since condition (i) cannot hold when A and B both have double eigenspaces, we 
assume (by switching the roles of A and B, if necessary) that the eigenvalues of B are 
distinct. 

There is an element h G SU{3) so that h{Bg~^Ag)h^^ is diagonal. Let 



C = h{Bg-^Ag)h-^ 










C2 








C3 



be the resulting matrix. Condition (ii) implies that ci,C2, and C3 are all distinct. 

If gt 6 5(7(3) is a path passing through g at i = 0, then gi = g{I + tX + 0{f^)) for some 
X e sm(3) and g^^ = {I - tX + 0{t^))g-^ . Since tr{AgBg-^) = tr(Bg-^Ag), we have 

d^X) = itr{Bg^'Agt)l^^ 

= tr{Bg-'AgX-g-^AgBX) 

= tr{Bg-^Ag ■ {X - BXB-^)) 

= tr{C ■h{X -BXB-^)h-^) 

= (ci - C3){iri) + (c2 - C3)(ir2), 

where iri and ir2 arc the (1, 1) and (2,2) entries of h{X — BX B~^)h~^ . (Here, rj € M since 

hiX - BXB-^)h-^ e su(3).) 

Write h — (hij) and let X have the form 



X = 



u 
-u 
—V —w 



V 

w 




(3.7) 



we compute that 

ri = 2^ {hnhi2{l - bib2^)u + hnhisil - bib^^)v + hi2hi3{^ - b2bs^)w) , 

r2 = 29 (/l2l/l22(l-&l62^)^* + ^21/123(1- 6163 ^)w + /l22/l23(l-&2&3^)w), 

where 3(a; + iy) = y is the imaginary part of a complex mimbcr. 

Suppose that two of the entries of (/ly) vanish. Orthogonality of the rows and columns 
of h then implies that two of the other entries of {hij ) also vanish. Thus h must send one of 
the standard basis vectors ej to another (possibly different) standard basis vector, perhaps 
multiplied by a unit complex number. Therefore ej is an eigenvector for both B and h~^Ch, 
and this contradicts condition (i). 

Thus at most one of the entries of (hij) equals zero. This implies that ri 7^ for some 
choice of u, v, and w. For if ri =0 for all u,v,w £ C, then two of {/in, /ii2, ^13} must vanish 
(because {61, 62, 63} are all distinct). Similarly r2 for some choice of u, v, and w. 

Since at most one of the entries of (hij) vanishes, one of the two cases holds: 

Case 1: each {/in, /iia} is nonzero, or 
Case 2: each {^21,^227/123} is nonzero. 

The proofs for the two cases are similar, and we supply the details for Case 1 only, leaving 
the rest of the argument to the reader. 

Notice that the set of matrices of the form (3.7) form a real vector space of dimension 
six. We will apply d(pg to a basis {Xi, . . . ,Xe} and show that the image spans C as a real 
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vector space. It is useful to make the simplifying substitutions: 

u' v' w' 
u = = — T- , V — = — =— , and w — = — r- . 

h^lh^^{\-h^h-^y h,^hi3{l-b,b-^)' /ll2/M3(l - M3 ') 

Define six distinct matrices Xi, . . . ,Xq G su{3) as in equation (3.7) as follows: for Xi and 
X2, take u' G {1, i} and v' = = w'; for X3 and X4, take v' G {1, i} and u' = = w'\ and 
for X5 and Xg, take w' G {1, and u' = Q = v' . We claim the set 

S={dVg{X,),...,d^g{X,)} 

spans C as a 2-dimensional real vector space. Suppose otherwise, namely suppose S does 
not span C. Condition (ii) implies that Ci,C2,C3 are all distinct, from which it follows that 
1^5^ ^ M. The only way S could be linearly dependent is if 

h2lh22 _ ^21^23 _ h22h23 ^ 

hiJii2 hiihi^ hi2hi3 
Taken one at a time, we obtain the three equations: 

Expanding along the bottom row of (/lij), these equations imply that det(/i) = 0, which 
contradicts the fact that h G SU{^) and completes the proof. □ 

Now suppose A,B,£ satisfy the hypotheses of Theorem 3.10. If we define 0: '^^^ C 
by setting </>([«]) = tr{a{x)a{y)), then the following triangle commutes: 

SU{3) 

Define A = 5'i7(3)/conjugation = maximal torus/Weyl group. This quotient space is a 
topological 2-simplex, described in Section 6 in more detail. The edges contain conjugacy 
classes of matrices with double eigenvalues, and the vertices are the conjugacy classes of the 
central elements. 

The map (j) '■ '^ab ^ clearly factors through the map ^ : '^^^ ~^ ^ sending a 1-^ \a{xy)], 
and the map tr: A —>■ C, which is smooth on the interior of the simplex. In Section 6 
(following Hayashi [16]) we identify the image ^{'>^ab) ^ (which we denote by Q^ib) ^ 
a convex polygon. Indeed, Q^is ^ hexagon if '^ab is a Type I component (i.e. if one of 
A 01 B has a repeated eigenvalue) and Q^ib nonagon if '^^^g is a Type II component 
(i.e. if A and B each have three distinct eigenvalues). If '^>fj^g is a Type II component, then 
^"^{p) is homeomorphic to a 2-sphere for all p in the interior Qj^g- 



Corollary 3.14. Set 'g'j'* = <^^b n R*{Z, SU{3)). Then ^|^«,. : "T^'* ^ A is a submersion 
except on the preimages of the intersection Q^^b ^ 

Proof. Lemma 3.13 effectively states that the differential of the composition tr ■ ^ab ~ 

C has rank 2 except on £^~^{dA). By the chain rule, the same must apply to ^L^,* . □ 

^ AB 

When '-(a^Q is 4-dimensional, the structure of the fiber £,~^(p) is described by Theorem 
6.3. We summarize this information below. 

Theorem 3.15. Suppose '^^b T^VP^ II component (i.e. 4-dimensional), and set Q^^b^ — 

Then O^''"'^ 7S / 
(i) A point ifp G 9Q5ib> 
(ii-a) A smooth 2-sphere if p G IntQ^B and p ^ Qa'b'^> 



^(.^ab"^)- Then Q^'if 1-dimensional and the fiber of ^ab ~* ^ over p G Q\b 
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(ii-b) A pointed 2-sphere if p & Int and p £ Qab ■ 
By a pointed 2-sphere, we mean a 2-sphere which is smooth away from one point. 

If a: TTiZ SU{3) is a representation with [a] G '^ab such that a{X) does not have 1 
as an eigenvalue, thenp = ^ Q'^ab ■ addition, p G IntQ^j^^, then it follows that 

^~^{p) is 0. smooth 2-sphere. 

Proof The subset '^ab'^ reducible representations can be identified with the image under 

* : TA\SU{3)/rB '^ab of the subset 

{g = idij) e SU{2,) I (?i2 = ffi3 = or gi3 = 523 = or 312 = 523 = 0} C SU{?>). 

This subset is 4-dimensional, and the principal orbits under the x action are 3- 
dimensional (because their isotropy subgroup of x Fb, which is 4-dimensional). Thus its 
image in Va\SU{2>)/Vb, and hence in '^ab'^^ 1-dimcnsionaI. 

Suppose that p = £,{[a\) e Q^a^- Then we have a reducible representation /?: ttiZ —* 
SU{3) with e ^~^{p)- Clearly (3{xy) and a{xy) are conjugate in SU{3). Since (3 is 
reducible and A lies in the commutator subgroup of tti{Z), it follows that /3(A) has (at least) 
one eigenvalue equal to 1. Because A = {xyy^h~^P~^'^^°' and a and /? send h to the same 
central element, it follows that a{X) and /3(A) are conjugate, and hence a(A) must also have 
1 as an eigenvalue. 

The rest of the statement follows from Theorem 6.3, and we explain the relationship be- 
tween the different notations here and there. Suppose A, B, C are diagonal SU{3) matrices 

with eigenvalues {e2'^^«i, e2'^*'^^ e^'^*'^-''}, {e^^^i, e2"^^ e^'^*''-''} and {e27rici^ g27ric2^ g27ric3}^ j.^,, 
spectively. Then ^~^([C]), the preimage in 't^ab of conjugacy class of C, can be identified 
with the moduli space ^abc described in Theorem 6.3. 

□ 

4. Perturbations 

The representation varieties for E and Z discussed in the previous sections can be iden- 
tified with the moduli spaces of flat SU{3) connections on E x SU{3) and Z x SU{3). The 
principal advantage of this perspective is that flat moduli space is the critical set of a func- 
tion on the space of all connections, modulo gauge, and this gives a framework to perturb 
for transversality purposes. In particular, we deform the function of which the flat moduli 
space is the critical set, and consider the critical set of the deformed function to be the 
"perturbed moduli space." 

After introducing some notation, we will define the twisting perturbations and analyze 
their effect on the moduli space. Of central importance is the behavior of pointed 2-spheres 
under twisting perturbations. In Subsection 4.3, we show that under a twisting perturbation, 
every pointed 2-sphere resolves into two pieces: an isolated reducible orbit and a smooth, 
nondegenerate 2-sphere. 

4.1. Gauge theory preliminaries and the odd signature operator. Fix a 3- manifold 

X with Riemannian metric. Let: £/{X) be the space of SU{3) cormcctions over X, com- 
pleted in the if topology, "^{X) be the group of SU{3) gauge transformations, completed 
in the L| topology, ^{X) be the quotient j^/{X)/'i^{X) , and ^{X) be the moduli space 
of gauge orbits of flat connections. 

When the manifold is clear from context, we will drop it from the notation and simply 
write £/, ^, ^ and 

The spaces and ^ are stratified by levels of reducibility, and we adopt a notation 

consistent with that used for the representation varieties. In particular: 

(i) ./^* is the moduli space of irreducible flat SU{3) connections. 

(ii) ^'''^'^ is the moduli space of reducible, nonabelian flat SU{3) connections. 
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(iii) j^'^^ is the moduli space of abelian, flat S'C/(3) connections. 
Given an SU (3) connection A, covariant differentiation defines a map 

dA ■■ .s?i(3)) ^ sm(3)). 

If A is flat, we obtain the twisted dc Rham complex 

(4.1) sw(3)) ^ rii(X; su(3)) ^ O^^^. _,,^(3)) ^ ^3^^. ^^^3)) 

with cohomology groups H\{X\su{^)) = ker(dA: ^^^), the Lie algebra of the stabi- 

lizer of A, and H\{X; su{'i)) = ker(dA: — > n^)/im(rf^: 0° Q^), the Zariski tangent 
space of ^ at [A]. When X is closed, the Hodge star isomorphism 0*(X;,sw(3)) ^ 
ri3-'(X;sM(3)) induces isomorphisms H\{X;su{3)) ^ sm(3)). The de Rham the- 

orem for twisted cohomology gives isomorphisms H\{X;su{3)) = H^{X; su{3)a) where 
a: TTi{X) SU{3) is the holonomy representation of the flat connection A. 

In this section, we will consider perturbations of the moduli space. The perturbations 
we use are of Floer type, meaning that we perturb the flatness equations in a neighborhood 
of a flnitc collection of loops in X (sec Definitions 4.2 and 4.4 below.) Given an admissible 
perturbation h, a connection ^ G ^ is called /i-perturbed flat if Fa = ★47r^V/i(A). We 
denote the moduli space of /i-perturbed flat SU{3) connections by For more details on 
perturbations in the SU{3) context, see Section 2.1 in [3]. 

If A is /i-perturbed flat, we deflne dA,h = — *47r^ Hess h{A) and the perturbed defor- 
mation complex 

(4.2) O0(X; sm(3)) ^ n\X; su(3)) ^ n^{X; su{3)) ^ n^{X; su{3)). 

The argument that (4.2) is Predholm when X is closed can be found in [24] or [17]. The first 
cohomology of this Frcdholm complex is denoted H\ i^{X; su(3)) = keT{dA,h)/ iin((iA) and 
is the Zariski tangent space of at [A] . The cohomology of this complex is independent 
of the choice of Riemannian metric on X since dA and dA,h are. 

Definition 4.1. The odd signature operator twisted by a connection A is the linear elliptic 
diflferential operator 

Da : n°+^X:su(3)) {X ; su{3)) 

Da{(7, t) = {d\T, dA<J + ★dAr). 

It can obtained by folding up the complex (4.1), although Da is defined whether or not A 
is flat. It is a generalized Dirac operator (in the sense of [8]). 

The perturbed odd signature operator is defined similarly using the complex (4.2), for a 
connection A and a perturbation h to be 

DA,h-- l^°+^(X;su(3)) — > l]"+^(X;sw(3)) 

DA,hisF,T) = {d*j^T, dAcr + *dA,hT) 

= {dAT, dAa + i^dAT - 4Tr^}icssh{A){T)) 
= DAi<7,T) + iO,-4TT^ResshiA)(T)). 
Here we use the metric to view Hess /i(A)(t) as a 1-form with su{3) coefficients. 

The Hessian is bounded as a map from to ([24], [3], [18]). Thus the composite 
of the compact inclusion of with the bounded Hessian ^ is a compact 

map Lf LP', and the addition of the Hessian to the signature operator is a compact 
perturbation. Since DA,h differs from Da by a compact perturbation, it is again Fredholm 
when X is closed. 

The usual Hodge theory argument shows that if X is closed, the kernel of DA,h is isomor- 
phic to h^X'^ su{3))®H\ i^{X] su{3)). When X is not closed, then DA,h is not Predholm. 
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The operators Da and Daji are symmetric: {DA.h{4'i)i4'2) = {(f'lj I^A.h{4'2)) if fpi and 02 
are supported on the interior of X. Thus if X is closed Da and DA,h are self-adjoint. 

The operator DA,h is not local. It is not a differential nor pseudodifferential operator. 
However, {Dam ~ DA){(t>) depends only on the restriction of A and (f> to the compact 
domain in X along which the perturbation is supported and moreover (-Da, ft, — Da){4') 
vanishes outside of this domain (in the case considered in this article, the compact domain 
is a neighborhood of the r-singular fiber). The proof of this fact can be found e.g. in [18], 
and follows in the present context straightforwardly from Proposition 4.3. 

Basic for us will be the splitting 

(4.3) i:{p,q,r)=Y\JTZ. 
Here, 

T = 5^ X 5^ = {(e",e'^)} 

is the 2-torus with the product metric and orientation so that dxdy is a positive multiple of 
the volume form. Its fundamental group i^i{T) is generated by the loops /x = {(e*^, 1)} and 
A = {(l,e'^)}. 

The 3-manifold Y is the solid torus 

r = X 5^ = {(re*^, e*^) | < r < 1} 

oriented so that drdxdy is a positive multiple of the volume form; it is a neighborhood of 
the r-singular fiber in S(p, q, r). Choose a metric on Y so that a collar neighborhood of the 
boundary is isometrically identified with [—1,0] x T. As oriented manifolds, dY = {0} x T. 
The fundamental group i^iiY) is infinite cyclic generated by the longitude A. (The meridian 
/U bounds the disc D"^ x {1} and so is trivial in 7ri(y).) 

The 3-manifold Z is the complement of an open tubular neighborhood of the r-singular 
fiber in E(p, g, r). Choose a metric on Z so that a collar neighborhood of the boundary 
dZ is isometrically identified with [0, 1] x T, and A is null-homologous in Z. As oriented 
manifolds, dZ = -{0} x T. 

The metrics on Y and Z induce one on S with the property that a bicoUarcd neighborhood 
of T C E is isometric to [—1,1] x T. We call [—1,1] x T the neck. Every connection A 
on S which is flat on the neck is gauge equivalent to one in cylindrical form, meaning that 
its restriction ijxt to the neck is the puUback of a connection on the torus under the 

projection [—1,1] x T ^ T. There are similar results for Y using the collar [—l,0]xTcY 
and for Z using [0, 1] x T d Z. A connection in cylindrical form and which is flat on the 
neck is gauge equivalent to one whose meridinal and longitudinal holonomies are diagonal. 

4.2. The twisting perturbation on the solid torus. In this subsection, we define the 
twisting perturbation and study the perturbed flatness equations on the solid torus. The 
crucial issue is to determine which flat connections on the boundary extend as perturbed 
flat connections over the solid torus. 

We begin with some notation. For a complex number C,, let 3?(^) be its real part and 
SJ(C) its imaginary part. Recall the parameterization $ : — > SU{3) of the maximal torus 
T C SU{3) given by equation (2.8). 

We use X = {xi,X2) for the coordinates on the 2-disk D"^ and 9 for the circle S^. Suppose 
77 : Z?^ ^ M is a radially symmetric nonnegative function supported in a small neighborhood 
of a; = with vi^) dx = 1. 

Fix a basepoint € S*^ . For a connection A on the solid torus D'^xS^, let holx {A) denote 
its holonomy around {x} x starting and ending at (a;, ^o)- Although holx{A) depends on 
the choice of basepoint, its trace trholx{A) is independent of this choice. 
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Definition 4.2. Define the twisting perturbation function /: s^ijfi x 5^) ^ R by setting 
(4.4) f{A) = -^ [ Q{trhoUA))r){x) dx 

Let M3(C) be the vector space of 3 x 3 complex matrices and regard su{3) as a subspace 
of M3(C). Define ng„(3) : M3(C) — » su{3) to be orthogonal projection with respect to the 
standard inner product on Ms{C). 

Proposition 4.3. The gradient of the perturbation of (4-4) given by 

V/(^) = -^llsu(3) hol^iA)) n{x) d0. 

Proof. If A is a connection on and a is an su(3)-valued 1-form on S^, then Proposition 
2.6, [3] gives the differentiation formula 



-^9<r holx(A + sa) 
ds 



= Qtr{hol^{A)Jg^ a), 

s=0 

where J^i a is interpreted as in Section 6 of [3]. 

Prom equation (4.4), f{A + so) is clearly independent of all components of a except the 
dO component. We can find its derivative by integrating the formula in the circle case: 

(4.5) ^f{A + sa) = -4^2 / 3 <r {hol,{A) J^, a) v{x) dx 

as Jd^ 

Since J^i a is su(3)-valued, we have 

Qtr{holx{A) Jgia) = -^tr{i holx{A)Jgia) 
(4-6) = {U,u(3){ihol^iA))Jg,a}^^^^y 

where we identify — tr{AB) with the standard inner product (•, ■)su{3) on su{3). Therefore 
equation (4.5) can be rewritten as 



^JiA + sa) 



Here, holx{A) is interpreted as a section of the bundle End(i?) of cndomorphisms of the 
rank three bundle E x . The section holx{A) is covariantly constant around the 

circle fibers with respect to the induced connection on End{E). □ 

Definition 4.4. Given t > 0, a connection A on the solid torus is called {tf) -perturbed flat 
if it satisfies the equation 

Fa = ^AnhVfiA) 

where denotes the curvature of A. Since r] is supported on a small neighborhood of 
S I?^, a (t/)-perturbed flat connection is flat near the boundary torus (see Proposition 
4.6 below). 

The next two propositions are well-known. The first was initially observed by Floer in 
[13]. Its proof is based on the previous observation that a perturbed flat connection has 
curvature only in the dxidx2 direction. 

Proposition 4.5. Suppose A is a connection on the solid torus. If A is (tf) -perturbed flat, 

then holx{A) is independent of x £ . 

Proof On the disk x {^o}, trivialize the SU{3) bundle using radial parallel translation 
starting at the center (0,6'o). For each x e D^, take the line segment Ox and consider the 
annulus Ox x S^. Since -kFA = idO, the restriction of A to this annulus is flat. But parallel 
translation along the line segment Oa; is trivial, and so holx {A) = holo {A) and is independent 
oixeD"^. a 
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Proposition 4.5 shows that for a perturbed flat connection A on the solid torus, we can 
denote holx{A) G SU{3) unambiguously by holx{A). We call this the longitudinal holonomy 
of A. The holonomy of A along the meridian dD'^ x {^o} is called the meridinal holonomy. 

The next result states that perturbed flat connections are flat outside a neighborhood of 
the perturbation curves. 

Proposition 4.6. // A is perturbed flat with respect to a perturbation h supported on a 
single thickened curve 7: x 5^ ^ S, then A is flat on the complement E — ^{D^ x S^). 

Proof. Under the hypothesis, the equation for perturbed flatness is -kFA = 47r^V/i(^), but 
yh{A) = outside the image j{D^ x S^). □ 



The twisting perturbation is well-defined as a function 

/:^(S(p,g,r))^R, 

once one fixes a framing on the solid torus Y in the decomposition (4.3). We use the framing 
Y = X in which the longitude A is homotopic to {x} x in the complement of K 
for all nonzero x & D"^. We assume further that the bump function t]{x) is supported in a 
small enough neighborhood that it vanishes on the neck [—1,1] x T. Proposition 4.6 then 
implies that every (i/)-perturbed flat connection A on E restricts to a flat connection on 
([-1,0] xT)\J Z. The deflnition of / and Proposition 4.3 show that f{A), Vf{A), and 
Hess/(^) depend only of the restriction of A to the interior of Y. 

The last result in this subsection determines an equation on meridinal and longitudinal 
holonomies that a connection A must satisfy in order for it to be (f/)-perturbed flat. 

Proposition 4.7. Suppose that A is a connection on D"^ x which is perturbed flat with 
respect to the twisting perturbation tf. Then there is a smooth gauge representative for [A]. 
Furthermore, if hol\{A) = ^{u,v), then the meridinal holonomy is given by 

(4.7) /io/^(A) = $ (— f sinusini;, |(cosucosi' — 2cos^ v + 1)) . 

Proof. The smoothness property holds for all holonomy type perturbations, not just the 
twisting perturbation we have deflned here. This is claim (1) of Lemma 8.3 in [24]. 

The second claim is a generalization to SU{3) (and imaginary part of trace) of a well- 
known fact for SU{2) perturbed flat connections, going back to Floer. Note flrst that 
V(t/) = tVf. Let A be a smooth ^/-perturbed flat connection, gauge transformed so that 
hol\{A) is diagonal. 

Since the curvature Fa = -kAn'^tV f{A) takes only diagonal matrix values, we can find the 
meridinal holonomy by integrating Fa over a disk that the meridian bounds, namely 

holi,{A) = exp(-/g^,A) 

= exp (-/padA) 

= exp(-/^,F(A)) 

= exp(-/^,4^2^V(t/)(A)) 

= cxp {tj^2^su{3){i holx{A)) r]{x) dxi Adx2) 

= exp {tllsu{3) {i holx{A))) . 
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The projection of a diagonal matrix B onto su{3) is given by taking the imaginary part of 
S — I tr{B)I. Applying this to ti hol\{A) shows that 

^su{3){iholx{A)) = n,u(3)i^{u,v) 



iai 











ia2 











ias 



where 

ai = ^ (2 cos(u + v) — cos(— u + v) — cos(2i))) , 

a2 = I (— cos(u + u) + 2 cos(— M + w) — cos(2w)) , 

as = I (— cos(u + u) — cos(— u + u) + 2 cos(2t;)) . 

Setting u = and v = Si±S2. and applying the angle addition formulas, we see 

that u = — sin ?i sin?; and v = ^ (cos u cost; — 2cos^ w + l) . These substitutions simplify the 
formula for holij,{A) to give 

holij,{A) = $ (— tsinusint;, I (cosucost; — 2cos^t; + l)) . 

□ 

Remark 4.8. Notice that if hol\{A) = 0) in the above proposition (namely if v = 0), 
then the conclusion is that holn{A) = $(0, |(cosu — 1)). 

4.3. The effect of the twisting perturbation on a pointed 2-sphere. We now consider 

twisting perturbations on S = YUt Z supported on the solid torus Y. In the last subsection 
we showed that any perturbed flat connection A on E is indeed flat on Z (Proposition 4.6) 
and we obtained an equation that the meridinal and longitudinal holonomies must satisfy to 
extend as a perturbed flat connection on Y (Proposition 4.7). In this subsection, wc use this 
equation to analyze the topology of the perturbed flat moduli space. We are particularly 
interested in the effect of the twisting perturbation on the pointed 2-spheres in We 
show that the perturbed flat moduli space near a pointed 2-sphcrc resolves into two pieces: 
an isolated gauge orbit of reducible connections and a smooth, nondegenerate 2-sphere of 
gauge orbits of irreducible connections. 

We identify the perturbed flat moduli space /(E) as the subset of the flat moduli space 
^{Z) of gauge orbits which extend as perturbed flat connections over the solid torus. We 
explain the geometric picture before going into details. 

The modiili space ./#(r) is the quotient of the product of two copies of the maximal torus 
of SU{3) modulo the diagonal action of Weyl group 5*3, the group of symmetries on three 
letters. Thus ^{T) is 4-dimensional. 

With respect to the splitting S = y Ut -Z^, we have restriction maps 

Cy ■■ y^{Y) ^ .^(T), : J^'^'^^Z) ^{T) and Cz ■ ^*{Z) ^{T) 

defined by sending [A\ to [^|t]- Denote the images of these maps by Sy = iiii(Cy), 
^J*"^ = 'm\{C,z'^) and = ™(G)- We also have restriction maps rz : ^(E) ^{Z) and 
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ry ■ ^(S) ^{Y), a commutative diagram 




(4.8) ^(S) ^(T) 




and similar diagrams for the reducible and irreducible moduli spaces. 

All three of Sfy, if^*"^ and arc codimension two submanifolds of ^(T). The map 
rz is injective. This is just the statement that the flat connections on E can be identified 
with those flat connections on Z which extend flatly over the solid torus Y. The crux of 
the matter is that the flat extension to the solid torus is uniquely determined by A\t up to 
gauge transformation. 

Thus the moduli space ^''^{T,) can be identified with 

rj'(^'-^(S)) = iCi^r^m = {[A] e ^^^^(Z) I [A\t] g n J^^}, 

and likewise we can identify as the subset of ^*{Z) given by 

rJ(^*(E)) - iCzr'i^Y) = {[A] e ^*iZ) I [^It] e^yn iT^*}. 

If [Aq] lies on a pointed 2-sphere, then C^*^ and Q are individually transverse to 3fy 
at [Ao|t]- But 3fy intersects both 2f^'^ and ^ at [^o|t], causing difficulties. The re- 
ducible part (Cz'^)^^([^o|t]) is simply [Aq], while the irreducible part (Cz)^^([^o|t]) is the 
complement of [Aq] in the pointed 2-sphere (and in particular is not compact). 

To make ^(S) non-degenerate, we apply a twisting perturbation which moves 3fy 
slightly. As with the flat moduli space, wc have a restriction map Cv.tf'- -^tf{Y) ^{T) 
defined by sending [A\ e ^tfiX) to [A\t]- (Recall that A\t is necessarily flat.) Denote the 
image of this map by Sfy^tf = im^Qy^tf). As before, we can identify the strata of reducible 
and irreducible gauge orbits in the perturbed flat moduli space as the subsets of ^{Z) 
given by 

•^tf (S) = {Cf )-\2fy,tf ) = {[A] G ^-^(Z) I [A\t] g 2fy,tf n iTi^"^}, 

and 

.^;/(E) = {Cz)-H.^Y.tf) = {[A] G J^*{Z) I [A\t] G ^y^tf n iTi}. 

We will show that for small t > ^y^t / intersects ^^""^ and ^ at points with nondegen- 
erate preimages in the following sense: {C,z'^)~^ {^Y,tf) is an isolated reducible connection 
[A] with H\{Z-,'C'^) = 0, and (C|)-^(^y.t/) a smooth 2-sphere. 

We will show this to be the case by determining, to flrst order in t, where this intersection 
point lies. The idea is to pin down their meridinal and longitudinal holonomies. 

Throughout the remainder of this section, will be a fixed reducible flat connection 
whose gauge orbit [Aq] lies on a 2-sphere component. Identify ^''"'^(E) with ^g^j^^2)x{7(i))(^) 
and note that [Aq] is a regular point of this latter moduli space. This follows because [Aq] 
can be represented by an SU{2) x {1} connection Aq and Proposition 2.2 implies that 

(S; s{u{2) X «(1))) = (S; su{2)) ® (S; u{l)) = 0. 

Regularity of ^'''^{Tj) near [Aq] implies that, for < t < e, there is a family of reducible 
(t/)-perturbed flat connections At which are deformations of Aq. Our first goal is to show 
that [At] is an isolated point in the perturbed fiat moduli space ^tf- 
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Proposition 4.9. Assume [Aq] is a gauge orbit of reducible flat connections on S that lies 
on a 2-sphere component. Choose a representative Aq in cylindrical form whose holonomy 
on the torus T is diagonal. Equation (3.5) gives that 

/io/,,(Ao) = $(2H2i,o) 

for some integer m with < m < r. For < t < e, let [Af] be the family of gauge orbits 

of reducible (tf) -perturbed flat connections near [Aq]. As before, choose representatives in 
cylindrical form. Since each At restricts to a flat connection on Z, we can also arrange that 
At has diagonal holonomy on the torus T. Then the holonomies satisfy: 

hol^iAt) = $(27rm,|(cos(22nn) _i)), 

hoh{At) = $(2£^,0). 

Proof. The Implicit Function Theorem implies the path [At] is smooth. As with single 
connections, the path of gauge representatives for [At] can be chosen to be smooth, in 
cylindrical form, and with the property that holxy{At) and holh{At) are diagonal. Note 
that by Proposition 4.6 these connections are flat on Z. 

Equation (3.5) and the discussion immediately preceding it imply that 

hol^y{Ao) = ^^,0) and holh{Ao) = I. 

Therefore, 

holxy{At) = ^{ut,vt) and holh{At) = $(0,u;t) 

for some functions Ut, Vt, Wt satisfying uq = vq = = wq- Here we know that holh{At) 
has the form stated because it commutes with the nonabelian representation hol{At) : ttiZ — »■ 
S{U{2) X [/(I)), so it is in the center of S{U{2) x U{1)). 
It follows from equation (2.4) that 

holfi{At) = ^{rut,rvt + cwt) and hol\{At) = ^{pqut,pqvt - {p + q)awt). 

Proposition 3.7 shows that the second argument in hol\{Ai), ivAmebf pqvt — {p+q)awt, must 
equal zero. Proposition 4.7 (see Remark 4.8) now implies that 

^{rut,rvt +cwt) = ^{0, ^{cos{pqut) - 1)). 

From this it follows that Mt = independent of and that to* +cw;t = | {cos{^^^^) - l). 

□ 

Corollary 4.10. For small enough t > 0, the representation at'. Tri{Z) SU{3) induced 
by the reducible flat connection At is twisted (i.e. takes values in S{U{2) x U{1)) but not in 
SU{2) X {!}; and satisfies H^{Z;ClJ = 0. 

Proof. Proposition 4.9 shows holf^{At) is twisted, and therefore at is twisted. The cohomol- 
ogy claim then follows from Proposition 3.4. □ 

Corollary 4.10 will be used in Section 5 to show that, for small t, the orbit [At] of reducible 
perturbed flat connections near [^o] is isolated in .^t/(S). 

We now turn our attention to understanding the effect of the twisting perturbation on 
the stratum of irreducible connections. We continue to assume that Aq is a reducible flat 
connection, in cylindrical form, with holxy{Ao) diagonal, and that [Aq] lies on a pointed 2- 
sphere. As pointed out in the proof of Proposition 4.9, there is an integer m with < m < r 
such that holxy{Ao) = $(^,0) and holx{Ao) = ^^^,0). 

Now consider an irreducible (t/)-perturbed flat connection A near Aq. We assume A is 
in cylindrical form on the neck and that the meridinal and longitudinal holonomies of A are 
diagonal. Since holry{A) is close to hol-y{Ao) for all 7 G 7ri(Z), we can write 

(4.9) holxiA) = ^{u,v) and holf,(A) = ^{w, z) 
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for w) near (^^^^^,0) and {w,z) near (0,0). Because the restriction of A to Z is irre- 
ducible and flat, holh{A) — I. (To see this, note that h G tti{Z) is central and holh{A) is a 
priori near holh{Ao) = I.) Equation (2.4) now implies that 

ihol^{A)r = {holxiA)Y , 

and plugging this into equation (4.9) gives that 

TU TV 

(4.10) w = 27rrn and z= — . 

pq pq 

On the other hand, if A extends as a (f/)-perturbed flat connection over Y, equation (4.7) 
implies that 

(4.11) w = —tsinusinv and 2; = i(cosucosi' — 2cos^ w + 1). 

Combining equations (4.10) and (4.11), we obtain a pair of equations (depending on the 

parameter t) which determine u and v. 

We now solve for u and v to first order in t. To facilitate the argument, define the function 
P: IR3 ^ IR2 gi^en 



P{t,u,v) = tsinusinu, ^ — | (cosucosw — 2cos^t; 
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The map {u, v) P(0, u, v) is clearly a submersion, and the Implicit Function Theorem 
provides smooth functions u{t) and v{t) near t = such that {t,u{t),v{t)) parameterizes 
the solutions of the equation P{t, u,v) =0 near (O, 2zE£2iri,o). Differentiating the equation 
P{t, u{t), v{t)) = with respect to t at t = yields 

«'(0) = and «'(0) = f (cos (2^) - 1) . 
Thus any irreducible (t/)-perturbcd flat connection A near Aq satisfies: 
hoh{A) = $ ^ (cos {'^) - 1)) + 0{t% 

hol^iA) = * (0, 1 cos {^^) - A) + 0(t2). 

This characterization of the longitudinal and meridinal holonomies of the perturbed flat 
irreducible connections near Aq allow us to prove the following theorem, which describes 
the perturbed flat moduli space of S in a neighborhood of the pointed 2-sphere. 

Theorem 4.11. Let S C .y^iT.) be a pointed 2-sphere, and let [Aq] G S he the gauge orbit 
of reducible connections. For a sufficiently small neighborhood ^ C ^{T,) of S, and for 
sufficiently small t > 0, ^ fl ^t/(S) consists of two components. The first is an isolated 
gauge orbit of reducible connections, and the second is a smooth 2-sphere of gauge orbits of 
irreducible connections. 

Remark 4.12. In this theorem we do not claim that the reducible connection [At] G ^(/(S) 
near [Aq] satisfies the nondegeneracy condition tfi^' su{'6)) = 0. This will be proved in 
Proposition 5.4. 

Proof. Choose a neighborhood '^z of [^o|x] in with the following properties: 



(i) n M*{Z) C where is the 4-dimensional Type II component of J(*{Z) 

containing [j4o|z], as in Theorem 3.10. 
(u) n .M'"\Z) C where 'e'"^ is the 2-dimensional component of Jf:""^[Z) 

containing [^o|z], as in Theorem 3.9. 
(ui) r-^{'^z) n ^(S) = S, where r: ^(S) .^{Z) is the restriction map. 
(iv) The restriction of Cz'^ to '^""^ H "^z is injective. 
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Set ^ = r-i('^z)- The intersection ^^f{^) n ^ is identified with 

{[A] G ^'^'^ n I [A\t] g ^i^'^ n ZY,ts}- 

This intersection is a single point, identified in Proposition 4.9 and the restriction map Q^'^ 
maps "^""^ n injectively into ^(T). Thus ^(^''(S) n is a single point. 
Now consider n , which is identified with 

{[A] G n I [A\t] e iTi n 

In equations (4.12) we have identified the unique point in Cz{^ H "Wz) n Zy.tf- This point 
has a 2-sphere preimage in %' n ';^z for small t, because "^f is topologically a 2-sphere bundle. 
This can be seen by observing that the map Cz : fl "^z — * ^{T'^) factors through 
^: n '^z ^ A, which sends a to [a{xy)], because a{h) = e^'^'^/^J, A = {xyfih-^+i^"- 
and /X = {xyYh'^. Again by equations (4.12), the longitudinal holonomy does not have 1 as 
an eigenvalue, and hence the 2-sphere fiber does not contain any reducibles, so by Theorem 
3.15 it is a smooth 2-sphere of gauge orbits of irreducible connections. □ 

5. Spectral flow arguments 

In this section, we perform computations of the spectral flow of the odd signature op- 
erator. These are necessary to calculate the contribution of the pointed 2-spheres to the 
invariant Tsu{i) (^) ■ The main result here is that, given a path At of reducible (t/)-perturbed 
connections on S where {Aq\ is flat and lies on a 2-sphere, the spectral flow of the per- 
turbed odd signature operator equals SF,[^2{At]Tj) = —2. This is proved by splitting the 
spectral flow according to the manifold decomposition S = YUt Z (Theorem 5.6), and then 
computing the spectral flow on Z (Theorem 5.7). 

5.1. The odd signature operator, spectral flow, and splittings. As in Section 4 we 
assume that S = T,{p,q,r) is endowed with a metric isometric to the product metric on a 
bicollared neighborhood [—1, 1] x T, where T, = Y \Jt Z. 

The operator Da is a self-adjoint Dirac-type operator. Thus on the closed manifold 
S(p, (7,r), Da has a compact resolvent and hence the spectrum of Da is unbounded but 
discrete, and each of its eigenspaces is finite dimensional. Although DA,h is not a Dirac- 
type operator, it is a compact perturbation of Da and also has a compact resolvent. 

Given a suitably continuous path Dt, < i < 1, of self-adjoint operators with discrete, 
real spectrum each of whose eigenspaces is finite dimensional, one can define the spectral 
flow SF{Dt) G Z to be the algebraic intersection in [0, 1] x R of the track of the spectrum 

{{t,X) \ te [0,1], AGSpec(A)} 

with the line segment from (0, — e) to (1, — e), where e > is chosen smaller than the modulus 
of the largest negative eigenvalue of Dq and of Di (this is called the (— e, —e) convention). 

If At is a continuous path of SU (3) connections on the closed 3-manifold X and ht a 
continuous path of perturbations, we denote by SF(DAt.ht', X) or SF(Ai, hi ; X) the spectral 
flow of the family of odd signature operators DAtM ^^^^ {X ; su{'i)) . (A proof that the 
family DAt is suitably continuous and a careful deflnition of the spectral flow can be found in 
[9] and [18].) The spectral flow is an invariant of homotopy rel endpoints, and to emphasize 
this point we will occasionally write SF{Aq, Ai, X) instead of SF{DAt.ht] ^) when the path 
of perturbations is understood (the parameter space of pairs {A, h) is contractible). 

If A is an S{U{2) x U{1)) connection on X, then Dam respects the decomposition on 
forms induced by the splitting of coefficients su(3) = s(w(2) x tt(l)) ® C^. In particular, 
for a path At of S{U{2) x U{1)) connections and path of perturbations ht, we denote 
by SFc2{At,ht;X) the spectral flow of the restriction of the path DaiM ri°"'"^(X; C^). 
Similar notation applies to the other summand in this decomposition of su(3). 
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In computing the spectral flow, wc connt eigenvalues with their real multiplicity, thus 
SFc2[At, ht] X) is always a multiple of two and we have 

SFgu(^3^{At,ht;X) = SFg(^u{2)xu{i))i^t,ht;X) + SFc2{At,ht;X). 

When X is compact but has nonempty boundary dX = W the constructions must be 
refined in order to obtain suitable families of operators for which one can define the spectral 
flow. We must draw on deeper results from the Calderon-Seeley theory of boundary-value 
problems for Dirac operators. 

Assume the metric on X is isometric to the product metric on a collar x (— 1, 0] of the 
boundary dX = Wx {0}. We work with connections A on X that are in cylindrical form, 
namely we assume that the restriction of A to the collar W x (—1,0] is the pullback of a 
connection a on under the natural projection W x (—1,0] W. 

Given an su(3) connection a on W, define the de Rham operator 

Sa{a, (3, 7) = {*da(3, - * daa -da* 7, da* 0). 

Here, *: f7*(VK; ,s?i(3)) r2^^*(VF; su(3)) denotes the Hodge star operator on W. Define 
to be the positive and negative eigenspans of this operator on the space of forms 
L2(no+i+2(^. su{2,))). 

If a is a flat connection on W, then the Hodge and de Rham theorems identify the kernel 
of Sa with the cohomology groups if^+^+^(VF; sm(3)) with coefficients in the local system 
5^(3) twisted by a. Define the operator 

J: nO+i+2(W^;su(3)) nO+i+2(W;su(3)) 
J(a,/3,7) = (- *7,*/3,*a). 

Notice that = —1. Setting w[x,y) = {x,Jy)i^2 defines a symplectic structure on the 
Hilbert space L"^ [^^'^^'^'^ (W ; sm(3))) of forms. By restricting this also gives a symplectic 
structure to ker^a- 

If A is an 5?7(3) connection on X in cylindrical form, and a is its restriction to the 
boundary dX = W, then along the collar W x [—1, 0], we have 

(5.1) Da = J {Sa + , 

where s denotes the collar coordinate. (See Lemma 2.4 of [5].) This holds more gener- 
ally for DA,h provided the perturbation is supported away from the collar. Given a La- 
grangian subspace L C kerS'a, the operator DA,h taken with domain those Lf sections 
(f> € i7''+^(X; su{3)) satisfying the APS boundary condition 

is self-adjoint with compact resolvent and hence discrete spectrum. Given a family {At, ht) 
and a choice of Lagrangian subspaces Lt C kerS'a^ so that Lt ® Pa^ is continuous, the 
spectral flow SF{DA,h,Pa) G ^ is well deflned (see e.g. [9]). In our context below we will 
have ker Sat = for all t and P+ continuous. 

Given a connection ^ on X in cylindrical form, and h a perturbation of the type we 
described above we deflne an (infinite-dimensional) Lagrangian subspace 

as follows. The main result of [18] implies that there is a well-defined injectivo map 

r: kev(^DA,h-- i?/2 {n°+\X : .su{3)) ^ L^,^^ (r!"+i(X; .sw(3))) ^ {n"+^+^{W; su{3))) 

given by restriction whose image is a closed, infinite dimensional Lagrangian subspace called 
the Cauchy data space of the operator DA,h on X and is denoted Ax,A,h- Since the restriction 
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map r is injectivc, kernel of Da^h with P+ (i.e. APS) boundary conditions is isomorphic to 
^x,A,h n Pa ■ When the context is clear, we will abbreviate ^x,A,h to Ax,a or even Kx- 

The space Kx,A,h varies continuously (in the graph topology on closed subspaces) with 
respect to A, h, and the metric on X. This result is well known in the case of Dirac-type 
operators (such as Da), see e.g. [8]. The theorems of the article [18] extend these standard 
results to the more general setting of small perturbations of Dirac operators such as DA,h 
(which is not a differential or even a pseudo differential operator). 

Remark 5.1. The previous remarks change slightly when the collar of dX is parameterized 
as [0, 1) xW with dX = {0} x W. The significant difference is that the positive eigenspan 
P+ of Sa is replaced by the negative eigenspan P~ . 

We will apply these observations to the decomposition S = F Ut ^- Parameterize a collar 
of the separating torus T as (—1, 1) x T in S, with (—1,0] x T a collar of the boundary of 
the solid torus Y and [0, 1) x T a collar of the boundary of Z. 

The fact that the operator DA,h on E is Predholm is equivalent to the fact that the pair 
{h.Y,A,h, ^z,A,h) form a Predholm pair of (Lagrangian) subspaces, and hence if {At, ^t)te[o,i] 
is a path, the Maslov index M.as{KY,A,h,^z,A,h) is well defined. Similarly the restriction 
of DA,h to Y with P+ boundary conditions is Predholm because the pair of subspaces 
{KY,A,h, Pa) Predholm, and the restriction of Da.Ii to Z with P^ boundary conditions is 
Predholm because the pair of subspaces {P^ ,^z,A,h) is Predholm. Proofs of these facts can 
be found e.g. in [21] or [19]. 

5.2. Some vanishing results. This subsection consists of an interlude to prove some 
needed vanishing results for the perturbed flat cohomology groups. To begin with, we 

note the following property of perturbed flat cohomology. The proof is the same as the 
standard proof of the exactness of the Mayer- Vietoris sequence and is left as an exercise. 
Note that the restriction of A to Z is flat and so ff{Z;C'^) = iJ^(Z;C^) and similarly 
for T. 

Lemma 5.2. If A is a (tf) -perturbed flat connection on S, the Mayer- Vietoris sequence 

■ • • ^ Hl{T; C) ^ Hl.fiH; C) ^ H^^fiY; C^) H\{Z; C^) ^ Hi{T; C) ^ ■ ■ ■ 
is exact. 

To use the Mayer- Vietoris sequence in the present context, we need to know the perturbed 
flat cohomology of the perturbed flat connections on Y. This information is provided by 
the following lemma. 

Lemma 5.3. For < 5 < ^, define the open rectangle 

Rg = {(u, v)\5 <u<2Tr-6, -(5/4 <v < (5/4}. 

Given < 6 < ^, there exists an e > such that, if —e < t < e then H'^{Y; C^) = and 
jj(F;C^) = for every (tf) -perturbed flat connection A onY with hol\{A) = ^{u,v) 

for (u, v) e Rs- 

Proof. Pix < (5 < ^ and consider the subset .J^s{Y) of ./# (Y) consisting of gauge orbits of 
flat connections A with hol\{A) conjugate to ^{u, v) for {u, v) in the closure of Rg. Obviously 
is a compact subset of Moreover, the conditions on {u,v) guarantee that holx(A) 
acts nontrivially on for all [A] S Prom this, it follows that H^{Y;C'^) = for all 
[A] € Poincare duality on the circle (a retract of Y) then gives Ha{Y; C^) = as well. 

On the closed manifold S, if ^ is a flat connection, then one may identify the cohomology 
H^{^; .su(3)) with the kernel of the operator dA®d*A : if f7P(E; su(3)) L'^nP+'^{j:; sm(3))© 
L^ri^'^^(E; sw(3)), which is elliptic and hence Predholm. On the manifold Y, with non-empty 
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boundary, one must impose Neumann boundary conditions for this to be an elliptic operator, 
namely replace the domain by 

LlnP{Y; su{3)) ^ Ll{a e 17^(2; su(3)) \Mt = 0}. 

The map Da is equivalent to the sum of the de Rham operator and its adjoint from odd 
forms to even forms, except that we have used the Hodge star operator to replace 3-forms by 
0- forms and 2-forms by 1-forms. Hence the appropriate Dirichlet/Neumann-type boundary 
conditions for Da are to restrict the domain to 

L?17°+i = {(a,/3) e Ll^f+\Y-su{:i)) \ ajr = 0,*/3|t = 0}. 

If A is not flat, then this operator Da differs from that of a flat connection (for example, 
the trivial connection) by a compact operator (see [24]). As pointed out above, the operator 
DA,tf also difi^ers from Da by a compact operator and hence, with these boundary condi- 
tions, is still Predholm. Again the (perturbed) cohomology H\{Y; sm(3)) © H\ ^^{Y] su{2>)) 
of a ^/-perturbed flat connection is identified with the kernel of this operator with the 
restricted domain. 

For flat connections A, we have [A\ e the kernel of Da restricted to L\U^'^J-iY] sm(3)) 
equals H^^^{Y;<C'^), which vanishes for [A] e .Ms by the previous argument. Using upper 
semicontinuity of the dimension of the kernel of a continuous family of Fredholm operators, 
the family DA,tf, with the same boundary conditions, must have trivial kernel neighborhood 
of ([j4o], O) for fixed [Aq] G ^s. Using compactness of wc obtain an eO such that if A is 
(t/)-perturbed flat for -e < t < e and if holx{A) = <^{u,v) for {u,v) e Rs, then H'^{Y- C^) 
and H\^f(Y; C^) vanish. □ 

As in Section 4, suppose Aq is a reducible flat connection on S whose gauge orbit [^o] 
lies on a 2-spherc component. For < t < e, let At be the family constructed in Subsection 
4.3 of reducible (t/)-perturbed flat connections on S limiting to [^o] as t — > 0. 

Proposition 5.4. Ift > is sufficiently small, then H\^ ^^{'S;su{3)) = 0. 

Proof. Wc split the coefficients according to the decomposition su{3) = s{u{2) x u{l)) ©C^ 
and argue the two cases separately. The fact that ff^^(E; s(u(2) x w(l))) = implies that 
the same holds true for the perturbed cohomology for small t. As far as the cohomology 
goes, we cannot make the same argument since iJ^^(S;C^) = C^. Instead, we combine 
Corollary 4.10 and Lemma 5.3, using the Mayer- Vietoris sequence, to obtain the desired 
conclusion. □ 

5.3. The spectral flow to the reducible perturbed flat connection. We turn now 

to an analysis of the spectral flow from the reducible flat connection whose orbit lies on a 
pointed 2-sphere to the nearby reducible perturbed flat connection. The set-up is as follows. 
We have a path At of reducible (t/)-perturbed flat connections on S such that Aq is a flat 
connection whose gauge orbit lies on a 2-sphere component. In Theorem 5.7 we compute 
the spectral flow 

SFc2{At,tf; S; 0<t <e) 

of the perturbed odd signature operators DAt,tf- f^°+HS;C2) 0,'^+^ {T,; C"^) from t = 
to t = e. The strategy is to use the machinery of Cauchy data spaces to prove a splitting 
result for spectral flow. This is accomplished in Theorem 5.6 which which shows that the 
spectral flow is concentrated on Z. The path At restricts to a path of flat connections on Z 
which allows us to compute the the resulting spectral flow by topological methods. (For the 
remainder of this subsection, we restrict DAt.tf to valued forms and write SF for SF£2 
without further reference.) 

As before we let at denote the path of flat connections on the separating torus T in the 
decomposition (4.3) and let Sat be the corresponding path of of twisted de Rham operators 
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on n'^+^+^(T; C^). Since the twisting perturbation is supported on the interior of the sohd 
torus and vanishes on the neck, it follows that the operators -D^t,*/ and Da^ coincide on 
([—1, 0] X T) U Z. Thus on the neck, equation (5.1) gives that 

(5.2) DA„tf = J{Sa, + 

Let denote the positive and negative eigenspans of the operator Sat- Denote by 
Ay(i) C L2(r2"+^+2(r; C^)) the Cauchy data space of the operator DAt,tf on Y and by 
Az(t) the Cauchy data space of DAt,tf on Z. Thus the kernel of DAt,tf is isomorphic to the 
intersection A.Y{t) fl h.z{t). 

Let be Y with a collar of length R attached, namely 

y« = yu([0,i?] xT). 

Any connection A E si/ [Y) in cylindrical form extends in the obvious way to give a connec- 
tion on Y^ in cylindrical form. Thus the family DAt,tf of perturbed odd signature operators 
on Y extends (using (5.2)) to give a family of operators on Y^. Let AP(f) denote the Cauchy 

data space of the operator DA^.tf on f70+i(y^; C^). Similarly set = ([-i?, 0]xT)UZ 
and denote by A§(t) the Cauchy data space of the operator DAt,tf on f2°+^(Z^; C^). 

exists an e > such that <t < e implies 

= for all R>0. 

Pi- 

= for all R>0. 

Proof. As in Subsection 4.3, the reducible flat connection Ao has longitudinal holonomy 
holxiAo) = $(2^, 0) for some < fc < r. The matrix $(2i£2^, 0) acts nontrivially on C^, 
and it follows that Hl^{T;€?) = 0. Poincare duaHty impHes Hl^{T;€?) = 0, and Euler 
characteristic considerations give that Hl^{T; C^) = as well. Hence 

ker5„„=<+i+^(T;C2)=0. 

By upper semicontinuity, kev Sat — for small t. This proves (i). 

Proposition 2.10 of [5] states that if A is a flat S{U (2) x U{1)) connection on a 3-manifold 
X with boundary, and if a = A\gx, then Ax,Ar\P^ is isomorphic to the image of the relative 
cohomology in the absolute 

Image {H\{X, dX; C^) H\{X; C^)) . 

The proof involves identifying the intersection with the space of harmonic forms on the 
infinite cylinder and applying Proposition 4.9 of [1]. If Hl'^^^'^{dX; C^) = 0, then the image 
of the relative cohomology in the absolute is exactly H\{X: C^). 

Apply this result to the case A = Aq and X = Y^. Since H\^{Y'^;C'^) = (by 
Lemma 5.3), we conclude that A^(0) fl Pq = for all R. This generalizes to perturbed flat 
connections as follows. The proof of [1] that the space of harmonic forms injects into 
H\{X; C^) works just as easily to show that the space of solutions to DAt,tf{'^, r) = on 
Y°° injects into H\ j^(F; C^). But Lemma 5.3 shows that H\ ^f(Y; C^) = 0. This proves 
(ii). 

Assertion (iv) follows by applying the same argument to the case A = A^ and X = Z. 
Note that Proposition 4.9 implies that, for e > small enough, H\ {Z; C^) = 0. 

Assertion (iii) follows from (i) and (ii) and a theorem of Nicolaescu ([21, Corollary 4.11]; 
see Theorem 2.7 of [5] for the result in the present context). Similarly, Assertion (v) follows 
from (iv). □ 



Lemma 5.5. There 

(i) kerS'at = 0. 

(ii) AP(f)nP+ = 

(iii) lim A§{t) = 

R—*oo 

(iv) Af(6)nPr = 

(v) lim Af (e) = 

H—^oo 
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The restriction of the operator DAt,tf to Z coincides with Da^ on Z. The operator DA,tf 
restricted to those sections whose restriction to the boundary he in Pf is a well-posed 
elliptic boundary value problem which, furthermore, is self-adjoint since ker Sa^ = 0. This 
implies that the spectral flow SF(DAt.if- Z; Pf^) is wcU-dofincd. (These arc well-known 
facts, originating in [1], whose proofs can be found in many places, e.g. [19].) 

The next result is a splitting theorem which uses the vanishing of cohomology on the 
solid torus Y to localize the spectral flow on the knot complement Z. 

Theorem 5.6. For small e > 0, 

SF{DA„tf; S; < t < e) = SF{Da,; Z; P"; < t < e). 

Proof. By part (i) of Lemma 5.5, wc have if°+^+2(T; C^) = for < t < e. A theorem of 
Nicolaescu ([21]; see also [19]) states that 

(5.3) SF{DA„tf;^) =MasiAY{t),Azit)). 

As in [5] and [10] , we use homotopy invariance and additivity of the Maslov index to complete 
the argument. (For a precise definition of the Maslov index in this context, see [21, 19] and 
[5, Definition 2.13]). 

Consider the 2-parameter family 



L{s,t) = 



'Al/'-^-'\t) forO<s<l 

pr if s = 1 



for < s < 1, < t < e. Lemma 5.5(iii) and the appendix to [10] shows that for each fixed 
t this is a continuous path. What we need is uniform continuity in the t parameter. Such 
families are not always continuous (see [5] for a discontinuous example) but in this case 
the family is continuous by [21, Corollary 4.12]. The required nonresonance hypothesis is 
exactly what Lemma 5.5 (ii) asserts. 

Since L{0, t) = Ai-(f) and L{1, t) = Pf , additivity and homotopy invariance of the Maslov 
index implies that 

(5.4) Mas(Ay(f),Az(t)) = Mas(P(.s, 0), Az(0)) + Mas(p-, A2(t)) - Mas(L(s, e), Az(e)). 
Since Aq is flat. Proposition 2.2 shows that, for < s < 1, 

dim(L(s,0) n Az(0)) =dimkeT Da„ = diia{H'^+\T,;C^)) =4. 

(Note, all dimensions computed here are real.) For t = 1, 

P(l, 0) n Az{0) = Po" n Az(0) ^ Image {H\^{Z, T; C^) ^ H\^{Z; C^)) . 

Since iJ°+^+^(r; C^) = 0, the image of the relative cohomology in the absolute is all of 
Ha^{Z; C^) which has complex dimension 2 by Proposition 3.1. Thus dim(L(s, 0) n Az{0)) 
is constant in t and it follows that 

(5.5) Mas(L(s, 0), A2(0)) = 0. 

By Part (iv) of Lemma 5.5, L(l, e) D Az{e) = 0. For < s < 1, we have 

dim {L{s, e) n Az{e)) = dimker {DA,,ef : n^+^H^; C^) ^ n°+\Yl^; C^)) 
= dimF°+i^^(E;C2) = 0. 

Here, = Ut Z is the result of adding a collar of length R to the neck. The 
computation that iJ^^]^^(S; C^) = follows by a Mayer- Vietoris argument, using Lemma 
5.3 and Proposition 3.11. Therefore 

(5.6) Mas(L(s,e),Az(e)) = 0. 
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Next, 



(5.7) Mas{p-,Az{t)) = SF{At; Z; P"; < i < e) 

(This result is also due to Nicolaescu; see [19] and [5, Theorem 2.18] for proofs in the present 
context). Combining (5.3), (5.4), (5.5), (5.6), and (5.7) with the observation that DAt,tf 
and agree on Z completes the argument. □ 

Theorem 5.6 reduces the problem of computing SFc2{DAt,tf', S) from the flat irreducible 
connection Aq and zero perturbation to the e/-perturbed flat reducible connection and 
perturbation e/ to the problem of computing the spectral flow on the knot complement, 
namely, SFc2{DAt', Z; ). This is a much easier problem for the following reason. The 
path of perturbed-flat connections At restricts to a path of flat connections on Z, and the 
kernel of Dj^^ acting on C^-valued forms with boundary conditions is isomorphic to the 
image of H^{Z,T;Cl^) H\Z;Cl^) (see the proof of Lemma 5.5). Corollary 4.10 then 
implies that this kernel is for f > 0, and Proposition 3.2 shows that the kernel is = 
for t = 0. We will prove that two zero modes become positive and two become negative, 
so that the spectral flow equals —2 (with our conventions). The homotopy will be a disk in 
the cyUnder 5^ x K of Theorem 3.9. 

Theorem 5.7. With e> as in Theorem 5.6, we have 

SF{DA,;Z;Pi;0<t<e) = -2. 

Proof. As mentioned above, for t = 0, the kernel of Daq with P~ boundary conditions has 
real dimension 4, but for t > 0, the kernel is trivial. 

In Subsection 3.2, we constructed 2-parameter families of reducible SU{3) representations 
on Z. These results give 2-parameter families of based gauge orbits of flat connections on Z. 
The based gauge group is the subgroup of "^{Z) consisting of those gauge transformations in 
the path component of the identity. The point is that spectral flow is a well defined concept 
for connections modulo based gauge transformations, so we can use the parameterization 
from Subsection 3.2 to compute spectral flow. 

If needed, gauge transform the path A^ so that its path of holonomy representations 
7t: T^i{Z) — > SU{3) takes values in S{U{2) x ?7(1)) and so that xy is sent to a diagonal 
matrix. Notice that 70 takes values in SU{2) x {1} since At is the restriction of flat connection 
on T,{p,q,r). Thus 70 lies on an arc a (see Definition 3.6) for some k,£, and e. The precise 
values of k,i, and e are not needed for our argument. 

Suppose that 70 = as„ for some sq G (0, 1). Proposition 4.7 (in particular (4.7)) shows 
that 7t lies off the seam of SU{2) x 1 representations for t > 0, and in particular 7^ is 
a S{U{2) X U{1) representation but not an SU{2) x {1} representation for t > 0. Hence 
Theorem 3.9 implies that 7^ is of the form as^^Ot for paths St S (0, 1) and 9t G [0,7r]. (We 
assume e is small so that 9t is also small.) 

Now the construction of Definition 3.6 gives a 2-parameter family of representations: 
namely the disk in the cylinder bounded by union of the 4 curves (see Figure 3): 

(i) 7( = as,,e,,tG [0,e], 

(ii) o.s,,{i-u)e,,u G [0, 1], 

(iii) a(^i-u)s,,o,u e [0, 1], 

(iv) auflyU G [0, So]- 

This disk determines a 2-parameter family of reducible flat connections 

{As,t |0<s<l,0<t<e} 

such that: 

(i) Ao,t = At for < i < e. 



36 




Figure 3. The family Ag^t is drawn as the shaded region, a subset of one of 
the cyhnders in R'''"^{Z, SU (3)). The seams are indicated by the two dotted 
lines which span the cylinder lengthwise. Taken clockwise from upper left 
hand corner, the four vertices are the flat connections Aq^^, Ai^^, Ai^ and 

^0,0- 



(ii) As,^ is a flat 5(i7(2) x U{1)) connection with ^{Z;C'^) = for < s < 1 (see 
Lemma 5.3). 

(iii) Ai^t is a flat abelian connection for < t < e and H\_^ ^ {Z; C^) = for < t < e. 

(iv) Asfl is a flat SU{2) x {1} connection with H\^^{Z; &) = for < s < 1. 

The parameterization in s and t may be chosen so that, when s is near 1, the t parameter is 
simply twisting, hol-y{Ag^t) equals the twist of hol-y{As^o) by the character sending /z to e**. 
This family parameterizes a thin strip on the cylinder 5^ x R with the edge corresponding 
to (iii) in the abelian flat connections. We assume that A^^t is in cylindrical form and has 
diagonal holonomy on the boundary. 

Let as,t denote the restriction of Ag^t to the torus, and let P^^ be the positive and negative 
eigenspans of Sa^^f Since 

ker(5,,,)=<+i+2(T;C2)=0 

for < s < 1 and < f < e, the Lagrangian spaces P~j vary continuously. Thus the 
odd signature operator Da^ ^ acting on sections over Z with P^^^ boundary conditions is 
a continuous 2-parameter family of self-adjoint operators. This 2-parameter family gives a 
homotopy from the path Daq ^ , < t < e, to the composition of the three paths 

(i) Da,„ 0<s< 1. 

(ii) Da,,„ 0<t<e. 

(iii) < s < 1 

and hence 

SF{DaJ = 5i^(DA„ J.e[o,i] + SF{DA,,Jte[o,e] + SF{DA,_,Jse[o,i]. 

The flat connections Ag.t act nontrivially on C^, so it follows that H'^ (Z;C^) = for 
all s,t. The path Ag^, < s < 1 runs along the seam of the cylinder and Propositions 3.2 
and 3.5 show that ^{Z; C^) = for < s < 1. By choosing e sufficiently small, we 
can arrange that ^ {Z; C^) = for < s < 1 and < t < e. (For this deduction, notice 
that Ag^i has been twisted out of the SU{2) x {1} stratum for t > 0.) 

Since the kernel of Da, ^ with P" boundary conditions is isomorphic to the image with 
H^^^{Z,dZ;C'^) i?^+|(Z;C^) (see the paragraph preceding the statement of Theorem 
5.7), and this restriction map is surjcctive by Proposition 3.2, it follows that along the first 
path Da^^o the kernel is constant (and 4-dimensional) and along the third path the kernel 
is trivial. Hence the spectral flow along the flrst and third paths vanishes. Thus 

SF{DA,y, Z; Poy,0<t<e) = SF{DA,y, Z; P.y, < t < e) . 
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We have now reduced the proof to compTitiiig SF{Daj^ Z: Pii ', < t < e), along the 
path At^i of abeUan flat connections. We will show that the 4 zero modes bifurcate into two 
positive and two negative eigenvalues. The idea of the argument is simple but the execution 
is a bit technical, so we outline the argument first. We will embed the path Aj i, t G [0, e] in a 
2-parameter family Bu,v, {u, v) G so that A^^i corresponds to a short path starting at the 
origin moving along the positive t;-axis. The operator Db^ „ with P~ boundary conditions 
will be seen to have kernel of dimension 2 along the two lines v = u/3 and v = — ?i/3 (and 
hence 4-dimensional kernel at the origin). The spectral flow along the u axis through the 
origin (i.e. 5F(£>b^ u,P~, —e<u< e)) equals 4 or —4. Thus in the 4 cone shaped regions 
complementary to the two lines, the two regions containing the positive and negative v axis 
must correspond to two of the zero modes becoming positive and two becoming negative. 

Since Ai^t is an abelian flat connection on Z, it is completely determined by its meridinal 
holonomy. Suppose /ioZp(j4i.o) — ^{uo,0) and let Bg t be a 2-parameter family of abelian 
flat connections with i?o,t = ^i,t and holn{Bs,t) = ^(wo + s,t). Notice that each Bgfi is an 
SU{2) X {1} connection. 

By [1], the kernel of Db, t with boundary conditions is isomorphic to the image of 
the relative cohomology in the absolute 

Image (ff ^j^^ (Z, T; C^) ^ Hj,^ ^ (Z; 

For s and t small, H*g^^{T;£?) = 0, so the latter image is simply Hj^ ^{Z:C'^), which is 
computed in Proposition 3.4. In the present context, this proposition implies that, for small 
s and t, the kernel of Db^ ^ with P~ boundary conditions is 

'C2 ifs = t = 0, 
C ifi = ±f^O, 
otherwise. 



For paths of SU (2) x {1} connections, the odd signature operator respects the quaternionic 
structure on , and for this reason, the spectral flow 

SF{Bs,o; Z; P-; -e< s <e) = ±4 

(cf. Theorem 6.12 in [5]). We assume this spectral flow equals +4. The argument in the 
other case is similar and is left to the reader. Because there are only four zero modes, all 
at s = 0, we see that the spectral flow along the first half of this path {(s, 0) | — e < s < 0} 
must also equal +4 (by our spectral flow conventions). 

The straight line {(s,0) | — e < s < e} is homotopic to the semicircle {(— ecos0, esinf?) | 
< 9 < tt}. The semicircle passes through the two diagonal lines through {uo,0) exactly 
once. Each time it crosses a diagonal line t = ±|, exactly one eigenvalue (of multiplicity 
two) of Db^ t crosses zero from negative to positive (since the total spectral flow is +4). 
Thus, the spectral flow along the quarter circle {{—ecosO, esin^) \ < < 7r/2} must equal 
+2. Of course, the quarter circle is homotopic to the composition of the two straight lines 
{(s,0) I — e < s < 0} and {(0, t) | < t < e}. We already concluded that the spectral flow 
along the flrst line equals +4, hence the spectral flow along the second must equal —2. Thus 

SF{Bo,t;Z; P"; < t < e) = -2. 

In other words, the behavior of the four zero modes of Da^ ^ as t increases from t = is 
that two go up, the other two go down. This completes the proof. □ 

6. Applications 

In this section, we present computations of the integer valued SU (3) Casson invariant 
Tsu(3) for Brieskorn spheres E(p, q, r). As we know from Theorem 2.6, there are exactly four 
types of path components, so our flrst task is to explain how each type contributes to tsu(3) ■ 
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This reduces the problem of computing Tsu{a) (^(Pj 9j ^)) to an enumeration problem, which 
we then phrase and solve in terms of counting lattice points in rational poly topes. From 
this, we deduce that tsu(3) is a quadratic polynomial in n for 1/n-Dehn surgery on a {p, q) 
torus knot, and more generally for the families S„ = T,(p,q,pqn + m) for p,q,m > Q fixed, 
relatively prime integers with m < pq. 

6.1. The integer valued SU(3) Casson invciriant. In this subsection, we review how the 
different component types contribute to the integer valued SU (3) Casson invariant defined 
in [6]. For Brieskorn spheres S, let h he a small perturbation so that is regular. The 
SU{3) Casson invariant is given by 

(6.1) '"'^"^^ , . 

+ i E (-l)"^(^'^^^)(2^J^C=(A,A;I])+dimif^(S;C2)). 

In this formula, dimil^ refers to the real dimension and A is a reducible fiat connection 
chosen close to a fixed representative A of the gauge orbit [A] G ^f^- 

Remark 6.1. The general definition oiTsu{S) iii [6] is more complicated; it involves choosing 

two basepoints and [A^] for each path component of ^/'^^ . But for Brieskorn spheres 
S, ^'"''(S) is discrete, so we take = y4._, and the definition of [6] reduces to (6.1). 

Using standard results from Morse theory, one can show that each Type la or Type Ila 
path component contributes ±1 times its Euler characteristic to Tsu{i)- It is a general fact 
(cf. the proof of Lemma 7 in [6]) that isolated reducible orbits with vanishing normal co- 
homology do not contribute to tsu{3,)- Thus the Type lb components do not contribute to 
TS(7(3)- For the Type lib components, the pointed 2-spheres, we apply the twisting pertur- 
bation to resolve the singularity and then use the spectral flow computations of Section 5 
to calculate the contribution. These results are summarized in the following theorem. 

Theorem 6.2. Suppose T, is a Brieskorn sphere. The contribution of a given path compo- 
nent of R{T,, SU{3)) to the integer valued SU{3) Casson invariant tsu(3) depends only on 
the component type and is as follows. 

(i) Type la components, which are isolated points of conjugacy class of irreducible 5(7(3) 
representations, contribute +1 to tsu{3){'^)- 

(ii) Type Ila components, which are a smooth 2-spheres of conjugacy classes of irre- 
ducible SU{3) representations, contribute +2 to Tsuis)^^)- 

(iii) Type lb components, which are isolated points of conjugacy classes of reducible SU{3) 
representations, do not contribute to r5^(3)(S). 

(iv) Type lib components, which are pointed 2-sphere containing one conjugacy class of 
reducible SU{3) representations, contribute +2 to tsu(3){^)- 

Proof. This theorem uses Proposition 5.1 from [2], which states that for any irreducible 
fiat SU{3) connection A on S, the adjoint su{3) spectral flow SF{Q,A) is even. Given a 
nondegenerate component C i?*(S, SU{3)) and [A\ S Proposition 8 of [4] states that 
-if contributes to A Sf/(3). But the only difference between the invariants 

''"5(7(3) and Asj/(3) is in their correction terms. In other words, on the level of the irreducible 
stratum, these two invariants coincide. Thus, since components of Types I and II are 
nondegenerate, we conclude that components of Type la contribute +1 and components of 
Type Ila contribute +2 to tsu(3){^)- 

Next, consider a component of Type lb. Thus "jf — {[^o]} for an isolated reducible 
orbit [Aq] e J^''"^. Proposition 2.2 implies H\^{T.;C'^) = 0. Given a generic path ht 
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of small perturbations, the path Ai of nearby reducible /ij-perturbed flat connections also 
have H^^ hti^'^ '^^) = 0. As a result, SFc2{At,ht; S) = and we conclude that components 
of Type lb do not contribute to tsu(3) ■ 

Finally, consider a component '^S' of Type lib. So "if is a pointed 2-sphere and has two 
strata: = U 'rf'^'^. Let tf be the path of twisting perturbations on S as in Section 4. 
Denote by C the part of the (f/)-perturbed flat moduli space of S near As we 
have shown, for t small, is a disjoint union of two components 

% = %* U 

Choose e > as in Theorem 5.6 and suppose [Bt] G "^^^ is a path of gauge orbits of 
irreducible (t/)-perturbed flat connections on S for < f < e. Then su{3)) = 

for < t < e, and hence 

SF{Bt,tf;Y.;0 < t < e) = 0. 

Since SF(Q, Bq;Y^) is even, another application of Proposition 8 of [4], together with the 
fact that "vf* is a nondegenerate 2-sphere, shows that contributes +2 to tsu{3){^)- 

Now suppose [At] S ^/^"^ is a path of gauge orbits of reducible (t/)-perturbed flat con- 
nections on S. Corollary 5.4 implies that {[^t]} is isolated for < t < e, and Theorems 
5.6 and 5.7 imply that S {Aq , A^; T,) = —2. In addition. Proposition 2.2 tells us that 
iI^^(E;C2) =C2. Thus 

2SFc2{Ao, A,-E) + dim//i^(E; C^) = -4 + 4 = 0, 

and the contribution of "^"^ to tsu(3){^) is 0. Consequently, each component of Type lib 
contributes +2 to tsu{3){^)j and this completes the proof. □ 

6.2. SU(3) fusion rules. The set of SU{3) matrices modulo conjugation is parameterized 
by the 2-simplex 

(6.2) A := {(ai, a2, aa) e | ai < 02 < 03 < oi + 1 and ai + 02 + 03 = 0}. 

Suppose r is a discrete group and a G i?(r, SU (3)). Define the map : F — » A by sending 
7 e r to the unique (01,02,03) e A such that 0(7) has eigenvalues e^'^'"! , e^'^'"^ , e^'^*"^ . 

The fundamental group of a thrice-punctured 2-sphere has the presentation G = {x,y, z \ 
xyz = 1), where x,y,z are represented by loops around the three punctures. (Of course G 
is a free group on 2 generators.) Given any representation a: G ^ SU{3), the assignment 
a (Aa(a;), Xa{y), Xa{z)) defines a map 

R{G, SU{3)) — > A X A X A. 

The following theorem, due to Hayashi (see Theorems 3.3 and 3.4 of [16]), describes the 
image of this map as a convex 6-dimensional polytope ^ in A x A x A. 

Given a, 6, c e A, let ^abc be the moduli space of fiat connections on a thrice-punctured 
2-sphcre with monodromies around the three punctures specified by a, b, c. Clearly ^ahc 
can be identified with the fiber of the map \1/ over (a, 6, c). 
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Theorem 6.3. The moduli space ^abc is nonempty if and only if a = (01,02, as), b = 
(61,62,63) and c = (ci,C2,C3) satisfy the 18 inequalities: 



(6.3) 



01 + 62 + C2 < 
^2 + 61 + C2 < 

02 + 62 + Ci < 



0-2 
03 



62 + C3 > 

63 + C2 > 
62 + C2 > 



oi + 63 + C3 > 
as + 61 + C3 > 
03 + 63 + ci > 



Oi 
"3 



61 + C3 < 
63 + ci < 
61 + ci < 



02 + 63 + C3 < 1 

03 + 62 + C3 < 1 
03 + 63 + C2 < 1 



Ol 
Oi 
02 



61 
62 
61 



C2 > 
Ci > 
Ci > 



-1 
-1 
-1. 



Let ^ = {(a, 6, c) | all 18 of the inequalities (6.3) are satisfied}. Then ^ = ini(^') is con- 
vex and 6- dimensional. Moreover, ./^abc is hom,eom,orphic to a 2-sphere if {a,b,c) lies in 
the interior of and a point if (a, b, c) lies on the boundary of . 

These equations can be used to describe the irreducible stratum R*{Z,SU{3)) of the 
representation variety of mZ as follows. Fix A,Bg SU{3) and i e {0, 1, 2} as in Theorem 
3.10 and let a, 6 G A be the conjugacy classes of A, B, respectively. Recall the presentation 
(2.3) for TTiZ and denote by 'rf^^ C R{Z,SU{3)) the subset consisting of conjugacy classes 



of representations a: ttiZ SU{3) such that Xaix) = a, Xa{y) = b, and a{h) = e^'^'^/^/. 
(This set was denoted "^if^g in Theorem 3.10.) 
The assignment a 1-^ Xa{{xy)^^) defines a map 

Let Q^j, = im{ip^f^) be the image of this map, so Q^j, is the intersection of ^ with the 
2-dimensional slice obtained by fixing a and b. Solving equations (6.3) for Ci, 02,03, we see 
that 



<3ab C A = {(ci, C2, C3) e I ci < C2 < C3 < ci + 1 and ci 
consists of triples (ci, C2, C3) satisfying the six inequalities: 

Xi < ci < Xu, 
Ye < 02 < F„, 
Ze < C3 < Zu, 



C2 + C3 = 0} 



where 



X( = max{-l - Ol - 62, -1 - 02 - 61, -03 - 63}, 

Xu = min{— Ol — 63, —03 - 

Ye = max{ — 1 — Ol — 61, - 

Yu = min{— Ol — 62, —02 - 

Ze = max{-oi - 63, -03 

Zu = min{-oi - 61, 1 - 02 - 63, 1 - 03 - 62}. 



■1 - 02 - 61, -03 - 
' 61,-02 - 62}, 
-02 - 63, -03 - 62} 

- 61, 1 - 03 - 63}, 

- 61, -02 - 62}, 



Using these equations, one can determine that is either a hexagon or a nonagon, de- 
pending on whether 'rf^^ is a Type I or II component, respectively (recall the definition of 
Type I and II in Theorem 3.10). With a little more work, one sees that the vertices of Q^j, 
are given by 

(6 4) ^1 = (^"'-^"-^^'^^)' V2 = i-Yu-Ze,Yu,Ze), t/3 = (X,, r„, -X^ - y„), 
V4 = {Xe,-Xe- Zu,Zu), V5 = {-Ye - Zu,Ye, Zu), Ve = {Xu,Ye,-Xu-Ye), 



41 



in the hexagonal case (i.e. when ^^j, is Type I), and by 

Vi = (X„, -X„ - Z,, Z,), V2 = [-2Z,, Zt, ZfX = (-2K, y„), 

(6.5) Vi = (X,, r„, -X^ - Yu), = [Xi, -1 - 2Xi, 1 + Xi), Ve = (Z„ - 1, 1 - 2Z„, 

= {-Ye - Zu, Ye, Z„), Vs = (Ye, Ye, -2Ye), Vg = (X„, X„, -2X„), 

in the nonagonal case (i.e. when "^^j^ is Type II). 

6.3. Lattice points in rational polytopes. In this subsection, we use Ehrhart's theorems 
on enumerating lattice points in rational polytopes to establish two results. The first, 
Theorem 6.4, is essential for the computations in Subsection 6.4. It shows that the integer 
valued SU (3) Casson invariant on homology 3-spheres obtained by 1/n surgery on a torus 
knot (or torus-like knot) is a quadratic polynomial in the surgery coefficient n. The second 
result, Proposition 6.7, enumerates Type I and II components in the SU{3) representation 
variety of knot complements Z obtained by removing one of the singular fibers of T,{p, q, r). 

To begin, suppose S = Y,{p,q,r) is a Brieskorn sphere and Z is the complement of a 
regular neighborhood of its singular r-fiber. Recall the presentations (2.2) and (2.3) for the 
fundamental groups ttiE and ttiZ. Restriction from S to Z defines a natural inclusion map 
i?(S, ^[/(S)) ^ R{Z, SU{3)), under which 

(6.6) R{i:,SU{3)) = {a: mZ SU{3) | aUxyYh") = /}/conj c R{Z,SU{3)). 

Any irreducible representation a: ttiZ SU{S) must send ft, to a central element, thus 
a{h) = e^'^*^/^/ for some £ G {0, 1,2}. Hence a{x) and a{y) are p-th and q-th roots of the 
central element a{h)'' = e^'r*^"/^/, and the results in Subsection 3.2 imply that R*{Z, SU{3)) 
is a union of components ^^j, over all a,b £ A and £ G {0, 1, 2}, of the form 

(6 7) a = ( ^ -ii-i2 \ h = (n 21. -ji-h \ 

where ii,i2,ji,j2 are integers satisfying ii =12 = ji = 32 = 0'£ (mod 3). 

A conjugacy class [a] £ 'i'^f, with representative a: niZ ^ SU{3) extends to a represen- 
tation of TTiS = TTiZ/ {(xyYh'^) if and only if a{{xyYh'^) = I. Setting c = Xa{{xy)~^) € Qai,, 
we see that a extends if and only if 

(6-8) c=(|^,|^,-%^) 

for integers fci, ^2 such that fci = ^2 = c£ (mod 3). 

In this way, we reduce the problem of computing Tgu^^^ (S) to one of counting lattice 
points of the form (6.8) in the regions Q^f,, for all a,b,£ satisfying (6.7). Of course, some 
lattice points contribute +1 and others contribute +2, depending on the topology of the 
fiber of ipab (cf. Theorem 3.15). This is a routine matter, as the topology of the fibers is 
constant within the interior of Olb- 

The same approach can be used to perform computations for the entire family of Brieskorn 
spheres 

I]„ •.= Y:{p,q,pqn + m), n > 0, 
where p, q, m are fixed, pairwise relatively prime positive integers with m < pq. We have 
described i?(S„, SU{3)) as a disjoint imion of points and 2-spheres. Under the identification 
(6.6), each point and 2-sphere corresponds to a lattice point in one of the regions Q^b- 
Observe that the regions Q^j, are themselves independent of n; the dependence on n is 
entirely through the denominators of the lattice points via equation (6.8) and r = pqn + m. 

Theorem 6.4. Suppose p,q,7n > are pairwise relatively prime with m <C pq- Set — 
S(j3, q,pqn + to). Then Tsu{3)i'^n) is a quadratic polynomial in n of the form 

rsu{3){^n) =An^+Bn + C. 
Obviously C = tsu(3) (^(P) ^)) (^nd vanishes for m = ±1. 
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Our proof uses Ehrliart's results on counting lattice points in rational poly topes [11], so 
we begin by introducing notation and defer the proof to the end of this subsection. 

A lattice polytope IP in is a convex polytope whose vertices lie on the standard 
integer lattice A = Z^, and a rational polytope =S in is one whose vertices have rational 
coordinates. Equivalently, ^ is rational if the dilated region = {dx \ x G =S} is a lattice 
polytope for some positive integer d. For example, the 2-simplex A of equation (6.2) is a 
rational polytope which, when dilated by = 3, is a lattice polytope. 

We are interested in counting lattice points in integral dilations n^P of such polytopes. 
Denote by /a(-^, n) = # {n^ fl A), the number of lattice points in n^. Ehrhart showed 
that if is a lattice polytope, then /a(^^, n) is a polynomial in n of degree dim 3^ . Ehrhart 
also proved that if ^ is a rational polytope such that is a lattice polytope, then fK{^, n) 
is a quasi-polynomial of degree dim=S and periodicity d, where (see [11] or p. 235 of [23]). 
Recall that a quasi-polynomial /(n) of degree j and periodicity is a function of the form 

i 

i=0 

whose coefficient functions Oi (n) are periodic in n of period d. 

Fix p,q,m and set E„ := T,{p,q,pqn + m) as in the theorem. Choose integers a„,c„ 
satisfying 

(6.9) an{pqn + m){p + q) + Cnpq = I 

as in Proposition 2.1. Denote by Z„ the complement of a regular neighborhood of the 
{pqn + m)-fiber in S„ = S(j3, q,pqn + m). The fundamental group iTiZn has presentation 
(x, y,h \ x^ = y'' = h"-", h central). We will see that the Type I and II components "^^j, of 
R{Zn, SU{3)) are independent of n. (Here, as established in Theorem 3.15, components of 
Types I and II have real dimension two and four, respectively.) 

We will identify components of i?*(E„, 5'J7(3)) with the union over all a,b of certain 
lattice points in Q^j, C R^, and a key point is that these regions depend only on a, 6 and 
not on n. 

Lemma 6.5. The numbers he chosen so their values modulo three are independent 

of n. Moreover: 

(i) // hath p and q are relatively prime to 3, then we can choose an,Cn so that a„ = 
(mod 3) and Cn =pq^O (mod 3). 

(ii) // either p or q is a multiple of 3, then we can choose an, Cn so that an = {p+q)m ^ 

(mod 3) and c„ = — m ^ (mod 3). 

Proof. We start with a„,c„ satisfying (6.9) and use the substitutions = a„ + pqk and 
•^n = c„ — k{p + q){pqn + m). For example, in case (i), we can choose k so that a'^ is 
a multiple of 3 since pq is relatively prime to 3. Reducing equation (6.9) modulo 3 then 
implies that c'^ = pq (mod 3). In case (ii), the mod 3 reduction of equation (6.9) gives that 
a„ = {p + q)m before (and after) making any substitutions. Now since {p + q)m is relatively 
prime to 3, so is {p + q){pqn + m), and it follows that we can substitute so that = — rn 
(mod 3). □ 

Remark 6.6. In case (i), a consequence of Lemma 6.5 is that a has the form (^, ^, ^"^^ ) 
and b has the form (— , — , ) when p, q are both relatively prime to 3 (cf. equation 

(6.7)). In this case, the three components "^^^ 5, "^^^ "^^^ (, have the same values for a, b. 

In case (ii), we see that £ is completely determined by a (or b) since a„ ^ (mod 3) 
when p or g is a multiple of 3. In this case, different values of £ require different values of 
a, b. 
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The next result gives an enumeration of the number of Type I and Type II components 

in R{Zn,SU (3)). 

Proposition 6.7. Suppose is the complement of the {pqn+m) -singular fiber in S(p, q,pqn+ 
m). Then there are 

Ni = iP-m-l)iv + ,-^) 

(p-l)(p-2)(g-l)(g-2) 

= 12 

components of Type I and Type II in R{Zn,SU{3)), respectively. 

The next lemma is the key to proving this proposition. 

Lemma 6.8. Suppose p G Z is a positive integer and I G {0, 1,2}. Let fe{p) denote the 

number of conjugacy classes ofp-th roots ofe^'^^^/'^I in SU{3) with three distinct eigenvalues, 
and let ge(j>) denote the number of conjugacy classes of p-th roots of e^'^^^^^I in SU{3) with 
two distinct eigenvalues. Then we have: 

— 3p + 2) ifp is relatively prime to 3, 
< ^{p^ — 3p + 6) ifp is multiple of 3 and i = 0, 
^(p^ — 3p) ifp is multiple of 3 and £ = 1,2. 



feip) 



geip) = < 



p — 1 if p is relatively prime to 3, 
p — 3 if p is multiple of 3 and 1 = 0, 
p ifp is multiple of 3 and 1 = 1,2. 



Observe that ^^"^=0 f^iP) ~ \{P ~ ^){P ~ ^^id ^^"^=0 9(iP) = 3p — 3 hold for all p. 

Proof. We begin by proving the stated formulas for fe{p) and ge{p) under the assumption 
that p is relatively prime to 3. 

Consider the analogous problems for U{3). Set ( = e^'^^lv and notice that a p-th root of 
unity in J7(3) has eigenvalues in the set {1, C,,C^,. . . , C^~^}. Conjugacy classes in J7(3) are 
uniquely determined by their eigenvalues, and it follows that there arc (!^) conjugacy classes 
of p-th roots of unity in ?7(3) with three distinct eigenvalues and that there are p(p — 1) 
conjugacy classes of p-th roots of unity in J7(3) with two distinct eigenvalues 

Multiplication by C defines a Zp action on these conjugacy classes. Using that det (C^) = 
Aat A, we sec that with respect to the map det: J7(3) the induced Zp action 

downstairs on J7(l) has weight three. If (3,p) = 1, the action is effective on the image 

det({A| AP = /}) = {l,c,c^•••,c''-^}• 

Thus, if (3,p) = 1, the number of conjugacy classes ofp-th roots of unity in any fiber 
deface*") is independent of k. Taking = 0, it follows that /o(p) = ^(3) = (p- l)(p- 2)/6 
and (7o(p) = p — 1 if (3,p) ~ 1. Now multiplication by e^'^*/'^ shows that fe{p) = fi+p{p) 
and ge{p) = ge+p{p). Thus, ifp is relatively prime to 3, it follows that fe{p) and ge{p) are 
independent of i € {0, 1, 2} and are as stated in the lemma. 

Now siippose p is a multiple of 3 and notice that the Zp action is no longer effective on 
the image det({A | = I}) = {1, . . , C^~^}. Since the action has weight three, there 

are precisely three orbits of the Zp action, one orbit for each residue class of k (mod 3), 
where det A = 

Claim 6.9. If p is a multiple of 3, then 

(i) ,/o(p) - ^^^^ and 

(ii) go{p) = p-3. 
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Establishing the claim proves the lemma, as we now c;xplain. Taking matrix inverses 
shows that fi{p) = hip) and gi{p) = g2{p)- As argued before, the total number of p-th 
roots of unity in U{3) with three distinct eigenvalues is (3) , and total number of p-th roots 
of unity in U{3) with two distinct eigenvalues is p{p — 1). This gives the formulas 

ELo/^W = |(?) = ^^^^ and ELo5.(p) = |(p^-p) = 3(p-1), 

which can then be used to solve for fi{p),gi{p) in terms of fo{p),9o{p)- 

Part (ii) of Claim 6.9 can be proved directly. Every conjugacy class is uniquely determined 

by its set of eigenvalues, which for a p-th root of unity in SU{3) with a double eigenvalue is 

a set of the form {C'^, C*^; C^^*^} for 1 < fc < p — 1 with k ^ m, 2m. (Note: the conditions on 

k ensure that C!^ ^ C^^*^-) There arc clearly p — 3 such sets. 

The direct argument for part (i) of Claim 6.9 is somewhat tedious, so we argue indirectly 

as follows. Note that the total number of conjugacy classes of p-th roots of unity in ^{/(S) 

includes the three central matrices /, e^'^*/^J, e^'^*/^ J, as well as the p — 3 conjugacy classes 

with two eigenvalues listed above. The set 

{(c,c',r"-')|i<a,&<p} 

of order p^ lists all possible eigenvalues of p-th roots of unity as ordered sets. Subtracting 3 
for the central roots and 3(p — 3) for the p-th roots of unity with two distinct eigenvalues 
(each one being listed 3 times as ordered sets), and dividing by the order of the symmetric 
group 53, we get that 

/o(p) = i(p'-3(p-3)-3) = £^^ 
as claimed. This proves the claim and completes the proof of the lemma. □ 

Proof of Proposition 6. 7. We consider the following two cases: 

Case 1: Both p and q are relatively prime to 3. 
Case 2: One of p or g' is a multiple of 3. 

Assume 1 holds and choose a„ = (mod 3) as in Lemma 6.5. Given an irreducible 
representation a: 7riZ„ SU{3), we have a{h) = e^'^^^l'^ for some I G {0, 1, 2}. Then for 
each a, 6 e A with p ■ a,q-b & h. = 1? ^ there are three isomorphic copies of "^^j,, one for 
each possible value of £. Thus Ni = 3(/o(p),go(<7) + 9o{p)fo{q)) and Njj = 3/o(p)/o(?), and 
the formulas for Lemma 6.8 complete the argument in this case. 

Now assume 2 holds, and note that a„ ^ (mod 3) by Lemma 6.5. Without loss of 
generality, we can assume that p is a multiple of 3 and that q is relatively prime to 3. 
The number of Type la components is given by summing over the possible values for £ G 
{0, 1,2}, and similarly for the number of Type Ila components. Lemma 6.5 implies that 
fiil) = 5(9 ~ 1)(9 ~ 2) and Qeiq) = Q — ^ independent of £. It also gives that 

2 2 
Y,MP) = l{P-^)iP-'^) and ^S^(p)=3p-3. 

Using these formulas, one computes that 



Ni = ^/€(p)5^(<?)+5^(p)^(g) = i(p-i)(<?-i)(p + g-4), 
2 

Nu = ^/,(p)/,(«) = ^(p-l)(p-2)(g-l)(g-2), 
completing the proof of the proposition. □ 
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Proof of Theorem 6.4- It is enough to show that the eontribiition of each component ^^^f^ 
in R{Zn, SU{3)) to Tsu(3){^n) is quadratic in n. As with the proposition, there are two 
cases. 

Case 1: Both p and q are relatively prime to 3. 
Case 2: One of p or g' is a multiple of 3. 

In order to apply Ehrhart's theorem, we consider translations of the standard lattice and 
(in Case 2) of the rational polytopes Q^j,. 

Assume 1 holds and choose a„ = (mod 3) and c„ = pq (mod 3) as in Lemma 6.5. As 
noted in Remark 6.6, the sets Q^j, are identical for the different £ € {0, 1,2} corresponding 
to the different choices for a{h) = e^'^*^/^/. It follows from equations (6.4) and (6.5) that 
(5^5 is a rational polytope whose dilation by d = is a lattice polytope. 

When £ = 0, the component ^^j, contributes 

fA{Qlb,pqn + m) = # {{pqn + m)Q°b n A) 

to T5;7(3)(S„), where A = is the standard integer lattice in K^. By [11], fA{Qab' ^) ^ 
quasi-polynomial of periodicity d = pq, and we see that fAiQab^P^''^ ~^ ™) polynomial in 
n simply because the residue class of pqn + m modulo d = pq is constant. 

This same idea should work for ^ = 1,2, but there are difficulties adapting the argument 
to these cases individually. Instead, we combine the three cases £ = 0, 1, 2 by superimposing 
the three sets of lattice points. This is possible here since (5°5 — Qab ~ Qab- denote 
this subset as Qab for the remainder of this argument. 

Let A' be the 3-dimcnsional lattice in K"^ generated by the vectors (1, 0, 0), (0, 1, 0), (^, ^, 5). 
As a set. A' is the union Aq U Ai U A2, where 

A, = A+(f,f,f) 

is the translate of the standard integer lattice A by the vector (f , f , f ) • Alternatively, A' 
is the lattice which intersects the unit cube [0, 1]^ at its vertices and at the interior points 
(i, i, -i) , (|, |, I) . It is evident that A' contains the standard integer lattice as a sublattice. 

Given an arbitrary lattice A in R^, we call a convex polytope a A-lattice polytope if 
has vertices on A; and we call ^ a A-rational polytope if d^ is a A-lattice polytope for some 
dilation by a positive integer d. Let /a(.^, n) = # (n^ n A) be the number of lattice points 
in the dilated region. Ehrhart's theorems translate immediately to this setting because the 
entire picture can be pulled back to the standard situation by a linear map which takes A 
isomorphically to the standard lattice. 

Returning to our situation of the nonstandard lattice A' in R^, for a fixed i G {0, 1, 2}, 
it follows from equation (6.8) with r = pqn + m that the contribution of the component 
'^ab to Ts(7(3)(S„) is given by # {{pqn + rn)Qaf^ fl A^). Summing over we see that the 
contributions of the components U^=o'^ob ^^o Tsu(Z){'^n) are given by fA'{Qab,pqn + m). 
Note that Qab is a A'-rational lattice with d = pq, so fx'iQab, k) is a quasi-polynomial of 
periodicity d = pq. Again, since the residue class pqn + m modulo d = pq is constant, we 
conclude that fA'{Qab,PQn + m) is actually polynomial in n, completing the proof of the 
theorem in this case. 

Assume 2 holds and choose a„ = (p -I- q)m (mod 3) and c„ = —m (mod 3) as in Lemma 
6.5. If ^ = 0, then is a rational polytope with d = pq and the contribution of "^^j, to 
Tsu(3) (^n) is given by fAiQab^PQn+m). Since /a((3°5, k) is a quasi-polynomial of periodicity 
d = pq, and since the residue class of pqn + m modulo pq is constant, it follows that the 
contribution of "^^ab '''su{z)(^n) is a quadratic polynomial in n. 

If £ = 1 or 2, then Q^j, is a rational polytope with d = 2>pq, but that is not sufficient for 
our needs. Notice from equations (6.4) and (6.5) that the dilation pqQai, has vertices on 
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the translate 

Ae=A+(§,§,§) 

of the standard integer lattice A, where e S {0, 1,2} is given by e = —mi (mod 3). Fur- 
ther ,the contribution of ^^j, to Tsu{3){^n) is given by # ((pg'n + m)(5^j, fl A^) (because 

e = —mi = Cni (mod 3)). Although A^ is not really a lattice, wc can translate the entire 

situation by subtracting (|, |, |) from A^ and subtracting ^3^, 3^, from The 
resulting region, denoted here Q^;,, is a rational polytopc with d = pq. Moreover, 

fA{Qib,Pqn + m)=H^ ({pqn + m)gli, n a) = # {{pqn + m)g^i, n A,) , 

the contribution of "^^^ to Tsu{3){^n)- Now since fA{Qab^ ^) is a quasi-polynomial of peri- 
odicity d = pq, we obtain the desired conclusion and this completes the proof. □ 

6.4. Concluding remarks. Table 1 gives some computations of the integer vahied Casson 
invariant tsu{3) for Brieskorn spheres S(p, q, r). This extends the computations given in [6], 
where it was assumed that p = 2. 



s 


TSU{3){'^) 


i;(2,3,6n± 1) 


3n2 ±n 


S(2,5,10r7. ±1) 


33n2 ± 9n 


E(2.r). l()„ ± 3) 


:-!3»- ± 19;/ + 2 


S(2,7, 14n± 1) 


138^2 ± 26n 


E(2,7, 14n±3) 


138^2 ± 62n + 4 


2(2,7, 14n±5) 


138n2 ± 102n + 16 


S(2,9,18n±l) 


390n2 ± 58n 


E(2,9,18n±5) 


390n2 ± 210n + 24 


S(2,9, 18n±7) 


390n2 ± 298n + 52 


E(3,4, 12n±l) 


lOSn^ ± 21n 


S(3,4, 12n±5) 


105n2 ± 87n + 16 


S(3,5,15n±l) 


276n2 ± 40n 


S(3,5,15r;. ±2) 


276^2 ± 74n -h 2 


E(3,5,15n±4) 


276^2 ± 148n 16 


S(3,5,15n±7) 


276^2 ± 254n + 56 



Table 1. Calculations of the integer valued SU(3) Casson in- 
variant FOR SOME Brieskorn spheres S(p, g, r). 



Let Kp^q be the {p,q) torus knot and set X„ — l/n Dehn surgery on Kp^q. Then Xn = 
±Y.{p,q,r) for r = \pqn — 1|. Table 2 gives the value of Tsu(3){Xn) for various These 
computations were performed using MAPLE. 

For surgeries on torus knots, Theorem 6.4 asserts that 

TSU{3){Xn) = A{Kp^q)n^ - B{Kp^q)n, 

where A{Kp,q) and B{Kp^q) depend only on Kp q. There is a pattern for the leading coeffi- 
cient A{Kp,q) present in Table 2. If Ak{z) — ^i>QC2i{K)z'^'^ denotes the Conway polyno- 
mial of K, we conjecture generally that Tsu{'i){^n) has quadratic growth in n with leading 
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Table 2. The integer valued SU(3) Casson invariant for homol- 
ogy 3-SPHERES Xn OBTAINED BY 1/n SURGERY ON K^^^ 



coefficient 
(6.10) 

This is what one would expect from Frohman's work [14] on SU (n) Casson knot invariants 
in the case of n = 3, at least for fibered knots (cf. [15, 7]). It gives the formula 

(p2 - l)(g2 _ I)(2p2g2 _ 3p2 _ 3^2 _ 3) 
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which agrees with the data in Table 2. The coefficient B{K) of the linear term is not as 
well-behaved. For example, interpolating the data from Table 2, we get the formulas 



and 





lg + 3) 


if 9 


= 1 


(mod 4), 




lg-3) 


if 9 


= 3 


(mod 4), 


'^(20(z3 + 3(z2 


-48gH 


-25) 


if 9 


= 1 (mod 6), 


^ ^(20g3-3g2 


-48§H 


-2) 


if 9 


= 2 (mod 6), 


' ^(2093 + 392 


-48g- 


-2) 


if 9 


= 4 (mod 6), 




-48g- 


-25) 


if 9 


= 5 (mod 6), 


r 1^(16?^ + a' - 


-42(7 + 


25) 


if 9 


= 1 (mod 8), 




- 42g + 39) 


if 9 


= 3 (mod 8), 


1 ^(16<z-^ + ^2_ 


- 42g- 


39) 


if 9 


= 5 (mod 8), 




-42g- 


25) 


if 9 


= 7 (mod 8). 



5(^4,,) 



The increasing complexity of these formulas makes it difficult to guess a general formula 
for B{K) in terms of classical invariants of the knot. Nevertheless, it provides a negative 
answer to the question of whether Tsf/(3) is a finite type invariant. For suppose tsu{;?,) were 

vould 



a finite type invariant. Then, as explained to us by Stavros Garoufalidis, B{K 
necessarily be a polynomial in p and q. Since B{Kp,q) is obviously not a polynomial in p 
and q, it follows that tsu(?,) is not a finite type invariant of any order. 
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Notice that tsu(3) (^) is even in all known computations. Furtlica', a simple argu- 
ment using the involution on ^su(i) induced by complex conjugation proves evenness of 
Tsu{'i){^) under the hypothesis that iJ^(X;sM(3)) = for every nontrivial representation 
a: TTiX — > SU{2>). We conjecture that tsu{'3){X) is even for all homology 3-spheres. 



49 



References 



[1] M. F. Atiyah, V. K. Patodi, and I. M. Singer, Spectral asymmetry and Riemannian geometry. 1,11,111, 
Math. Proc. Camb. Phil. Soc. 77 (1975) 43-69; 78 (1975) 405-432; 79 (1976) 71-99. 

[2] H. U. Boden, Unitary representations of Brieskorn spheres, Duke J. Math. 75 (1994) 193-220. 

[3] H. U. Boden and C. M. Herald, The SU(3) Casson invariant for integral homology 3-spheres, J. Diff. 
Gcom. 50 (1998) 147-206. 

[1] H. U. Boden and C. M. Herald, A connected sum formula for the SU(3) Casson invariant, J. Diff. 
Gcom. 53 (1999) 443-465. 

[5] H. U. Boden, C. Herald, P. A. Kirk, and E. P. Klassen, Gauge theoretic invariants of Dehn surgeries 

on knots, Geom. & Top. 5 (2001) 143-226. 
[6] H. U. Boden, C. M. Herald, and P. A. Kirk, An integer valued SU{3) Casson invariant, Math. Res. 

Lett. 8 (2001) 589-603. 

[7] H. U. Boden and A. Nicas, Universal formulae for SU(n) Casson invariants of knots. Trans. Amer. 

Math. Soc. 352 (2000) 3149-3187. 
[8] B. Booss-Bavnbek and K. P. Wojciechowski, Elliptic Boundary Problems for Dirac Operators, 

Birkhauser, Boston, 1993. 

[9] B. Booss-Bavnbek, M. Lesch, and J. Phillips, Unbounded Predholm operators and spectral flow. To 
appear in Canadian Journal of Mathematics, Math. FA/0108014. 
[10] M. Daniel and P. Kirk, A general splitting formula for the spectral flow. With an appendix by K. P. 
Wojciechowski. Michigan Math. J. 46 (1999), no. 3, 589-617. 

[11] E. Ehrhart, Sur un probleme de geometric diophantienne lineaire II, J. reine angew. Math. 227 (1967) 
25-49. 

[12] R. Fintushcl and R. Stern, Instanton homology of Seifert fibred homology three spheres, Proc. London 

Math. Soc. 61 (1990) 109-137. 
[13] A. Floer, An instanton invariant for 3-manifolds, Comm. Math. Phys. 118 (1989) 215—240. 
[14] C. Prohman, Unitary representations of knot groups, Topology 32 (1993) 121—144. 
[15] C. Frohman and A. Nicas, An intersection homology invariant for knots in a rational homology 3- 

sphere, Topology 33 (1994) 123-158. 
[16] M. Hayashi, The moduli space of SU(3)-flat connections and the fusion rules, Proc. Amer. Math. Soc. 

127 (1999) 1545-1555. 

[17] C. Herald, Legendrian cobordism and Chern-Simons theory on 3-manifolds with boundary. Comm. 

Anal, and Geom. 2 (1994) 337-413. 
[18] B. Himpel, P. Kirk, and M. Lcsch Calderon projector for the Hessian of the perturbed Chem-Simons 

function on a 3-manifold with boundary, math.GT/0302234. 
[19] P. Kirk and M. Lesch, The rj-invariant, Maslov index, and spectral flow for Dirac-type operators on 

manifolds with boundary. To appear in Forum Math., math.DG/0012123. 
[20] E. Klassen, Representations of knot groups in SU{2), Trans. Amer. Math. Soc. 326 (1991) 795-828. 
[21] L. Nicolaescu, The Maslov index, the spectral flow, and decompositions of manifolds. Duke Math. J. 

80 (1995), no. 2, 485-533. 

[22] N. Saveliev, Lectures on the Topology of 3-Manifolds, An Introduction to the Casson Invariant, de 
Gruyter, Berlin, 1999. 

[23] R. Stanley, Enumerative Combinatorics, Vol. 1, Cambridge Studies in Adv. Math. 49, Cambridge Univ. 
Press 1997. 

[24] C. Taubes, Casson's invariant and gauge theory, J. Diff. Geom. 31 (1990) 547-599. 

Department of Math & Stats, McMaster University, Hamilton, Ontario L8S 4K1 Canada 
E-mail address: boden@mcmaster.ca 

Department of Mathematics, University of Nevada, Reno Nevada 89557 
E-mail address: heraldSunr . edu 

Department of Mathematics, Indiana University, Bloomington, Indiana 47405 
E-mail address: pkirk@indiana.edu 



50 



